2026-01-28 20:00:27 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-01-28 20:00:27 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-01-28 20:00:27 [ayvens.fr] INFO: Starting spider ayvens.fr
2026-01-28 20:00:27 [scrapy.addons] INFO: Enabled addons:
[]
2026-01-28 20:00:27 [asyncio] DEBUG: Using selector: EpollSelector
2026-01-28 20:00:27 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-01-28 20:00:27 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-01-28 20:00:27 [scrapy.extensions.telnet] INFO: Telnet Password: 526c64c660c86132
2026-01-28 20:00:27 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-01-28 20:00:27 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/ayvens.fr/task_73_2026-01-28T20_00_01.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-01-28 20:00:27 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:27 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-01-28 20:00:27 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-01-28 20:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-01-28 20:00:27 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-01-28 20:00:27 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:00:27 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-01-28 20:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:28 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: en
2026-01-28 20:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27en%27%20and%20RowKey%20eq%20%27en%27 HTTP/1.1" 200 None
2026-01-28 20:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2026-01-28 20:00:28 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-01-28 20:00:28 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-01-28 20:00:28 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-01-28 20:00:28 [scrapy.core.engine] INFO: Spider opened
2026-01-28 20:00:28 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-28 20:00:28 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-01-28 20:00:28 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:28 [scrapy-playwright] INFO: Starting download handler
2026-01-28 20:00:33 [scrapy-playwright] INFO: Launching browser firefox
2026-01-28 20:00:34 [scrapy-playwright] INFO: Browser firefox launched
2026-01-28 20:00:34 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-01-28 20:00:35 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2026-01-28 20:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-28 20:00:35 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://carmarket.ayvens.com/en-gb/lots>
2026-01-28 20:00:35 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/lots> (resource type: document)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/lots>
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4QVFFAQG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7YT6ABHA.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WFA2IVWG.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OF6JT4KC.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LVJXO4QX.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2N74OY7W.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-KZOV2SQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-P3E7UHUI.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WE77U2QS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2S63FZXS.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:37 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/polyfills-FFHMD2TL.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/main-O3OWKDIN.js> (resource type: script, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/styles-ETA5EMQJ.css> (resource type: stylesheet, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Medium.woff2>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Regular.woff2>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/Chillax-Semibold.woff2>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Bold.woff2>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OF6JT4KC.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-P3E7UHUI.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Regular.woff2>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WFA2IVWG.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-PGNL7WWW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-P3E7UHUI.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3HJTOVT5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-G7VKZLNV.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-IOF7VMBJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-WFA2IVWG.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-Medium.woff2>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2S63FZXS.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-KZOV2SQ2.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2N74OY7W.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7YT6ABHA.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LVJXO4QX.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WE77U2QS.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/polyfills-FFHMD2TL.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4QVFFAQG.js>
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-4CLCTAJ7.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-2N74OY7W.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-5HD3KQV3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-S5E5FHXZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-FB6RKR5I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HGXSF4AK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-2BYH6G4C.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AQBI4CYB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ALI5XYZJ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VGUEXTON.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:38 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LHCNJE3I.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7DYAUIPQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7C2GTJ24.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-KZOV2SQ2.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RQLFCBMH.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7YT6ABHA.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/styles/themes/fonts/ald/SourceSans3-SemiBold.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/main-O3OWKDIN.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/styles-ETA5EMQJ.css>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2> (resource type: font, referrer: https://carmarket.ayvens.com/styles-ETA5EMQJ.css)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-PGNL7WWW.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CMYMW4RH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-276SS4TV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7KVSNWE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3HJTOVT5.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-SPE4D2IX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OION63CA.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NO5FJ6IE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AVZZH6AV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJGQXDQB.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MADFXCQX.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ABBXN5WQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-57LOL62V.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MLMYZRAG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-JK3VA6V3.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-ECZFIAAV.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RWL6TUXQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-3ZRJENLY.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-AYT4KML6.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-35VRT2WM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CX65R3QQ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-WJPXCSUZ.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-GWHLDUVT.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LYOOO25D.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7LLFTWQ2.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-XCHSKDZH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-G7VKZLNV.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-IOF7VMBJ.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-4CLCTAJ7.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-5HD3KQV3.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-FB6RKR5I.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HGXSF4AK.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-S5E5FHXZ.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-2BYH6G4C.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AQBI4CYB.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ALI5XYZJ.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VGUEXTON.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LHCNJE3I.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7DYAUIPQ.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7C2GTJ24.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RQLFCBMH.js>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Regular-IWU2LEHA.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Medium-NIVAGDSI.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Bold-OH3V3LEB.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-Regular-VMJBJIXS.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/Chillax-Semibold-YNVWM5XA.woff2>
2026-01-28 20:00:39 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/SourceSans3-SemiBold-NPKTOIJ5.woff2>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CMYMW4RH.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7KVSNWE.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-276SS4TV.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-SPE4D2IX.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OION63CA.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NO5FJ6IE.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AVZZH6AV.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJGQXDQB.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MADFXCQX.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ABBXN5WQ.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MLMYZRAG.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-57LOL62V.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-JK3VA6V3.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-ECZFIAAV.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RWL6TUXQ.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-3ZRJENLY.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-35VRT2WM.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-AYT4KML6.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CX65R3QQ.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-WJPXCSUZ.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-GWHLDUVT.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LYOOO25D.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-XCHSKDZH.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7LLFTWQ2.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-U3DCL5KE.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HLMVA2XG.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens-white-bg_192x192.png>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/favicon/ayvens.svg>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-U3DCL5KE.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HLMVA2XG.js>
2026-01-28 20:00:40 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-J7WQD6B5.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HLMVA2XG.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-J7WQD6B5.js>
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7P3LAPEA.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://js.monitor.azure.com/scripts/b/ai.config.1.cfg.json>
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7P3LAPEA.js>
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6TCU7CUH.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-TXAFC7UM.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MIPFLQ72.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-J7WQD6B5.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6TCU7CUH.js>
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-RJDFUE4N.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HPJAYUCB.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-6TCU7CUH.js)
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-TXAFC7UM.js>
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MIPFLQ72.js>
2026-01-28 20:00:41 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-OIQIERBW.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-UFB65P4A.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-NTG4JAHX.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-7TECJER3.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-H7VMIGZK.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-RJDFUE4N.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HPJAYUCB.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-CJQ6ZMFR.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-UFB65P4A.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-OIQIERBW.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-NTG4JAHX.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-7TECJER3.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-H7VMIGZK.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/loader.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/loader.svg>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/line.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/flags/round-gb.svg>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/line.svg>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/logo-ayvens-carmarket.svg>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-K3XLXP2R.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MIPFLQ72.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HBBQKHO4.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-UFB65P4A.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-HXFSIYAP.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-QMSFYIWN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-TXAFC7UM.js)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-K3XLXP2R.js>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-28 20:00:42 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HBBQKHO4.js>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-HXFSIYAP.js>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-VZKIXU23.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-EOYYGPOY.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-HBBQKHO4.js)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/bell.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/bell.svg>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-QMSFYIWN.js>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://dc.services.visualstudio.com/v2/track> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://carmarket.ayvens.com/assets/images/next-breadcrumb.svg>
2026-01-28 20:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://carmarket.ayvens.com/en-gb/lots> (referer: None) ['playwright']
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-VZKIXU23.js>
2026-01-28 20:00:43 [ayvens.fr] INFO: Cookies from Playwright: [{'name': 'ai_user', 'value': 'qUWPnOhXVGMlNYOFLm8rcy|2026-01-28T20:00:40.579Z', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1801166440, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': -1, 'httpOnly': False, 'secure': False, 'sameSite': 'None'}, {'name': 'ai_session', 'value': 'tkARpyy/Xz6RR+9pukvCxv|1769630442404|1769630442404', 'domain': 'carmarket.ayvens.com', 'path': '/', 'expires': 1769632242, 'httpOnly': False, 'secure': True, 'sameSite': 'None'}]
2026-01-28 20:00:43 [ayvens.fr] INFO: Scrapy-formatted cookies: [{'name': 'ai_user', 'value': 'qUWPnOhXVGMlNYOFLm8rcy|2026-01-28T20:00:40.579Z', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'user_culture', 'value': 'en-gb', 'domain': 'carmarket.ayvens.com', 'path': '/'}, {'name': 'ai_session', 'value': 'tkARpyy/Xz6RR+9pukvCxv|1769630442404|1769630442404', 'domain': 'carmarket.ayvens.com', 'path': '/'}]
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Ayvens',RowKey='cookies') HTTP/1.1" 204 0
2026-01-28 20:00:43 [ayvens.fr] INFO: Intercepting token...
2026-01-28 20:00:43 [ayvens.fr] INFO: Scrolling element to trigger lazy load...
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-EOYYGPOY.js>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-6YCHXE2J.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-6YCHXE2J.js>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-MSBSCS6P.js> (resource type: script, referrer: https://carmarket.ayvens.com/main-O3OWKDIN.js)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/logo-ayvens.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/fr.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/flags/be.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-LMJCIPKN.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-7TECJER3.js)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/assets/images/chevron-down.svg> (resource type: image, referrer: https://carmarket.ayvens.com/en-gb/lots)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-MSBSCS6P.js>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://dc.services.visualstudio.com/v2/track>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://carmarket.ayvens.com/chunk-T4CT3E3U.js> (resource type: script, referrer: https://carmarket.ayvens.com/chunk-MSBSCS6P.js)
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/down.svg>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/logo-ayvens.svg>
2026-01-28 20:00:43 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-es.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-fr.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-be.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/fr.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-it.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/en-gb/content/trading/-/media/Project/ALD/shared/flags/Country-Sales/flag-de.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-LMJCIPKN.js>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/flags/be.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/assets/images/chevron-down.svg>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://carmarket.ayvens.com/chunk-T4CT3E3U.js>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/otSDKStub.js>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019908df-58e4-7710-aaa7-4d6e79279bd9.json>
2026-01-28 20:00:44 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/otBannerSdk.js>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/consent/019908df-58e4-7710-aaa7-4d6e79279bd9/019b4fc7-396b-7b6c-9b76-7b67f1d26cca/en.json>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [ayvens.fr] INFO: GraphQL headers: {'host': 'api.aldcarmarket.com', 'user-agent': 'Mozilla/5.0 (X11; Linux x86_64; rv:125.0) Gecko/20100101 Firefox/125.0', 'accept': 'application/json, text/plain, */*', 'accept-language': 'en-US,en;q=0.5', 'accept-encoding': 'gzip, deflate, br', 'content-type': 'application/json', 'content-length': '839', 'referer': 'https://carmarket.ayvens.com/', 'x-ald-subscription-key': '3b2cc62fd26c4e29a762db3de181266b', 'x-tenant': 'ald', 'x-country': 'gb', 'origin': 'https://carmarket.ayvens.com', 'sec-fetch-dest': 'empty', 'sec-fetch-mode': 'cors', 'sec-fetch-site': 'cross-site', 'proxy-authorization': 'Basic Y3VzdG9tZXItaW5maW5pdF9zb3VyY2luZ192Ml9QdGpxbi1jYy1FVTpLSks1eEVqSGtGek1GOFRBWEJoek1NckV5dFVYamZ1ZnhYQ0YzOFQ3ejMwNGo5TmtqRDJGNnhTdzdqNGRBdGFE', 'connection': 'keep-alive'}
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://api.aldcarmarket.com/graphql/saleevents> (resource type: xhr, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCenterRounded.json>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/v2/otPcTab.json>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/scripttemplates/202601.1.0/assets/otCommonStyles.css>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/14efa178-aa53-42e6-9a86-5229303798da/019908c4-f46e-7d64-b942-26aa1fec3635/2ab431a1-8f8c-4a55-9e1a-e5de23079c22/ayvens-logo.png>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/powered_by_logo.svg>
2026-01-28 20:00:45 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn.cookielaw.org/logos/static/ot_guard_logo.svg>
2026-01-28 20:00:46 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtm.js?id=GTM-W3J7744>
2026-01-28 20:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c>m=4e61r0> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c>m=4e61r0> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:46 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:46 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=DC-4340043&cx=c>m=4e61r0>
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://www.googletagmanager.com/gtag/destination?id=G-2R31MHSGCW&cx=c>m=4e61r0>
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=9664084236242;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=591253094.1769630447;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe61r0v9190173311z877415155za20gzb77415155zd77415155xea;gcs=G1--;gcd=13l3l3R3l5l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115495940~115616986~115938466~115938469~116185181~116185182~117041587;epver=2;dc_random=1769630447_JkzEskJNN1goMf0TQVH3qvGA3WgBctYNSA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=9664084236242;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=591253094.1769630447;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe61r0v9190173311z877415155za20gzb77415155zd77415155xea;gcs=G1--;gcd=13l3l3R3l5l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115495940~115616986~115938466~115938469~116185181~116185182~117041587;epver=2;dc_random=1769630447_JkzEskJNN1goMf0TQVH3qvGA3WgBctYNSA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=3962089534527;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=591253094.1769630447;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe61r0v9190173311z877415155za20gzb77415155zd77415155xea;gcs=G1--;gcd=13l3l3R3l5l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115495940~115616986~115938466~115938469~116185181~116185182~117041587;epver=2;dc_random=1769630447_3wFXuWrxrpHDM3Cq3lqfelDRQHYcmQ6HQQ;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=3962089534527;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=591253094.1769630447;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe61r0v9190173311z877415155za20gzb77415155zd77415155xea;gcs=G1--;gcd=13l3l3R3l5l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115495940~115616986~115938466~115938469~116185181~116185182~117041587;epver=2;dc_random=1769630447_3wFXuWrxrpHDM3Cq3lqfelDRQHYcmQ6HQQ;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://ad.doubleclick.net/activity;src=4340043;type=aldcar;cat=aldca0;ord=5185059193481;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=591253094.1769630447;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe61r0v9190173311z877415155za20gzb77415155zd77415155xea;gcs=G1--;gcd=13l3l3R3l5l1;dma=0;dc_fmt=3;tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115495940~115616986~115938466~115938469~116185181~116185182~117041587;epver=2;dc_random=1769630447_RJB01ipOWN20Vd-58RwqHIrxqPsXb_R8mA;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://4340043.fls.doubleclick.net/activityi;src=4340043;type=aldcar;cat=aldca0;ord=5185059193481;u=u2%3Dhttps%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots;npa=0;auiddc=591253094.1769630447;pscdl=noapi;frm=0;_tu=KFA;gtm=45fe61r0v9190173311z877415155za20gzb77415155zd77415155xea;gcs=G1--;gcd=13l3l3R3l5l1;dma=0;dc_fmt=2;tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115495940~115616986~115938466~115938469~116185181~116185182~117041587;epver=2;dc_random=1769630447_RJB01ipOWN20Vd-58RwqHIrxqPsXb_R8mA;_dc_test=1;~oref=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots?> (resource type: document, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://try.abtasty.com/372422ca89af404b029558678c4f42fd.js>
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://region1.analytics.google.com/g/collect?v=2&tid=G-2R31MHSGCW>m=45je61r0v877189330z877415155za20gzb77415155zd77415155&_p=1769630445618&_gaz=1&gcs=G1--&gcd=13l3l3R3l5l1&npa=0&dma=0&cid=1231067600.1769630447&ul=en-us&sr=1280x720&frm=0&pscdl=noapi&_eu=AAAAAGA&_s=1&tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115616985~115938466~115938468~116185181~116185182~116988316~117041587&sid=1769630447&sct=1&seg=0&dl=https%3A%2F%2Fcarmarket.ayvens.com%2Fen-gb%2Flots&dt=Used%20cars%20lots%20for%20sale%20-%20car%20auctions%20for%20dealers%20and%20traders%20%7C%20Ayvens%20Carmarket&_tu=KA&en=lots_page_view&_fv=1&_nsi=1&_ss=1&ep.site_country_event=gbr&ep.user_country_event=&ep.environment_event=prd&ep.page_name_event=%2Fen-gb%2Flots&ep.error_code_event=&ep.contains_error_event=false&ep.contains_user_info_event=false&ep.language_event=eng&ep.sale_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20null&ep.ic_info_event=undefined%20%7C%20undefined%20%7C%20undefined%20%7C%20undefined&epn.countdown_event=48558&up.user_country=&up.contains_user_info=false&up.language=eng&tfd=11961> (resource type: fetch, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://stats.g.doubleclick.net/g/collect?v=2&tid=G-2R31MHSGCW&cid=1231067600.1769630447>m=45je61r0v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcs=G1--&gcd=13l3l3R3l5l1&npa=0&frm=0&tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115616985~115938466~115938468~116185181~116185182~116988316~117041587> (resource type: other, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [ayvens.fr] INFO: ✅ Intercepted token: 3b2cc62fd26c4e29a762db3de181266b
2026-01-28 20:00:47 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 0
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://www.google.co.uk/ads/ga-audiences?v=1&t=sr&slf_rd=1&_r=4&tid=G-2R31MHSGCW&cid=1231067600.1769630447>m=45je61r0v877189330z877415155za20gzb77415155zd77415155&aip=1&dma=0&gcs=G1--&gcd=13l3l3R3l5l1&npa=0&frm=0&tag_exp=103116026~103200004~104527906~104528501~104684208~104684211~115616985~115938466~115938468~116185181~116185182~116988316~117041587&z=1293450854> (resource type: image, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/commons.f9c4ad88459841ba2e15.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/372422ca89af404b029558678c4f42fd/main.bcc3d04e238196752283.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/jquery.5434730a34a3135b52f6.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:47 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://try.abtasty.com/shared/me.56490845629cd5ac3849.js> (resource type: script, referrer: https://carmarket.ayvens.com/)
2026-01-28 20:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:00:49 [ayvens.fr] INFO: Found listing with ID: 1875607
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875607%27 HTTP/1.1" 200 None
2026-01-28 20:00:49 [ayvens.fr] INFO: Scrape type for 1875607: 2
2026-01-28 20:00:49 [ayvens.fr] INFO: Extracting data for car ID: 1875607
2026-01-28 20:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c601066d-a25f-5297-b9da-deb1cdd3b2dc with identifier: 1875607
2026-01-28 20:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c601066d-a25f-5297-b9da-deb1cdd3b2dc with scrape type 2
2026-01-28 20:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c601066d-a25f-5297-b9da-deb1cdd3b2dc with scrape type 2
2026-01-28 20:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c601066d-a25f-5297-b9da-deb1cdd3b2dc, identifier: 1875607
2026-01-28 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c601066d-a25f-5297-b9da-deb1cdd3b2dc with identifier: 1875607
2026-01-28 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:49 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c601066d-a25f-5297-b9da-deb1cdd3b2dc with identifier: 1875607
2026-01-28 20:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c601066d-a25f-5297-b9da-deb1cdd3b2dc with identifier: 1875607 to the API
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': 'SAPHIRSCHWARZ M',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-01-30T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c601066d-a25f-5297-b9da-deb1cdd3b2dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39121',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X3',
'odometer': 29815,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-10',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X3 X3 xDrive30e 292ch M Sport',
'transmission': 'automatic',
'trim': 'X3 xDrive30e 292ch M Sport',
'vin': None,
'year': 2023}
2026-01-28 20:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875607%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [ayvens.fr] INFO: Saving data for 1875607: {'auction_closing_time': 1769767200.0, 'created_time': 1769544040.275561, 'last_price_update_time': 1769630450.001517}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1875607') HTTP/1.1" 204 0
2026-01-28 20:00:50 [ayvens.fr] INFO: Found listing with ID: 1875608
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875608%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [ayvens.fr] INFO: Scrape type for 1875608: 2
2026-01-28 20:00:50 [ayvens.fr] INFO: Extracting data for car ID: 1875608
2026-01-28 20:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af615821-2af6-5153-a244-d6f18223c31a with identifier: 1875608
2026-01-28 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af615821-2af6-5153-a244-d6f18223c31a with scrape type 2
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af615821-2af6-5153-a244-d6f18223c31a with scrape type 2
2026-01-28 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: af615821-2af6-5153-a244-d6f18223c31a, identifier: 1875608
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: af615821-2af6-5153-a244-d6f18223c31a with identifier: 1875608
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: af615821-2af6-5153-a244-d6f18223c31a with identifier: 1875608
2026-01-28 20:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: af615821-2af6-5153-a244-d6f18223c31a with identifier: 1875608 to the API
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 134,
'color': 'SAPHIR SCHWARZ METAL NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-30T10:00:00Z',
'fuel_type': 'petrol',
'id': 'af615821-2af6-5153-a244-d6f18223c31a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39121',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 36468,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch M Sport DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch M Sport DKG7',
'vin': None,
'year': 2023}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875608%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [ayvens.fr] INFO: Saving data for 1875608: {'auction_closing_time': 1769767200.0, 'created_time': 1769544043.261149, 'last_price_update_time': 1769630450.833546}
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1875608') HTTP/1.1" 204 0
2026-01-28 20:00:50 [ayvens.fr] INFO: Found listing with ID: 1875609
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875609%27 HTTP/1.1" 200 None
2026-01-28 20:00:50 [ayvens.fr] INFO: Scrape type for 1875609: 2
2026-01-28 20:00:50 [ayvens.fr] INFO: Extracting data for car ID: 1875609
2026-01-28 20:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9f73722-1451-57be-9338-03493361c49d with identifier: 1875609
2026-01-28 20:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9f73722-1451-57be-9338-03493361c49d with scrape type 2
2026-01-28 20:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9f73722-1451-57be-9338-03493361c49d with scrape type 2
2026-01-28 20:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a9f73722-1451-57be-9338-03493361c49d, identifier: 1875609
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a9f73722-1451-57be-9338-03493361c49d with identifier: 1875609
2026-01-28 20:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a9f73722-1451-57be-9338-03493361c49d with identifier: 1875609
2026-01-28 20:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a9f73722-1451-57be-9338-03493361c49d with identifier: 1875609 to the API
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://api.aldcarmarket.com/graphql/saleevents>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'NOIR ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-30T10:00:00Z',
'fuel_type': 'petrol',
'id': 'a9f73722-1451-57be-9338-03493361c49d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39121',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 87573,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-13',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.3 TCe 130ch FAP Intens EDC// 2 PLACES - 2 SEATS',
'transmission': 'automatic',
'trim': 'Clio 1.3 TCe 130ch FAP Intens EDC// 2 PLACES - 2 SEATS',
'vin': None,
'year': 2020}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875609%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Saving data for 1875609: {'auction_closing_time': 1769767200.0, 'created_time': 1769544048.422284, 'last_price_update_time': 1769630451.378422}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1875609') HTTP/1.1" 204 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875610
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875610%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875610: 2
2026-01-28 20:00:51 [ayvens.fr] INFO: Extracting data for car ID: 1875610
2026-01-28 20:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78490b52-22a9-534f-b15e-9d296b033f13 with identifier: 1875610
2026-01-28 20:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78490b52-22a9-534f-b15e-9d296b033f13 with scrape type 2
2026-01-28 20:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78490b52-22a9-534f-b15e-9d296b033f13 with scrape type 2
2026-01-28 20:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 78490b52-22a9-534f-b15e-9d296b033f13, identifier: 1875610
2026-01-28 20:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 78490b52-22a9-534f-b15e-9d296b033f13 with identifier: 1875610
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 78490b52-22a9-534f-b15e-9d296b033f13 with identifier: 1875610
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 78490b52-22a9-534f-b15e-9d296b033f13 spider: ayvens.fr
2026-01-28 20:00:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 78490b52-22a9-534f-b15e-9d296b033f13 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 60,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-01-30T10:00:00Z',
'fuel_type': 'phev/petrol',
'id': '78490b52-22a9-534f-b15e-9d296b033f13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39121',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC60',
'odometer': 28209,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-01',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC60 XC60 T6 AWD 253 + 87ch Inscription Luxe Geartronic',
'transmission': 'automatic',
'trim': 'XC60 T6 AWD 253 + 87ch Inscription Luxe Geartronic',
'vin': None,
'year': 2021}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875610%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Saving data for 1875610: {'auction_closing_time': 1769767200.0, 'created_time': 1769544051.375865, 'last_price_update_time': 1769630451.748935}
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1875610') HTTP/1.1" 204 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875611
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875611%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875611: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875612
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875612%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875612: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875613
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875613%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875613: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875614
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875614%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875614: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875615
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875615%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875615: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875616
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875616%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875616: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875617
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875617%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875617: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875618
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875618%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875618: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875619
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875619%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875619: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875620
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875620%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875620: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875621
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875621%27 HTTP/1.1" 200 None
2026-01-28 20:00:51 [ayvens.fr] INFO: Scrape type for 1875621: 0
2026-01-28 20:00:51 [ayvens.fr] INFO: Found listing with ID: 1875622
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875622%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875622: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875623
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875623%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875623: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875624
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875624%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875624: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875625
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875625%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875625: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875626
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875626%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875626: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875627
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875627%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875627: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875628
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875628%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875628: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875629
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875629%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875629: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875630
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875630%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875630: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875631
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875631%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875631: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875632
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875632%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875632: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875633
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875633%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875633: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875634
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875634%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875634: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875635
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875635%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875635: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875636
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875636%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875636: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875637
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875637%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875637: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875638
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875638%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875638: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875639
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875639%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875639: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875640
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875640%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875640: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875641
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875641%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875641: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875642
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875642%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875642: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875643
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875643%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875643: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875644
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875644%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875644: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875645
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875645%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875645: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875646
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875646%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875646: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875647
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875647%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875647: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875648
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875648%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875648: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875649
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875649%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875649: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875650
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875650%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875650: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875651
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875651%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875651: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875652
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875652%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875652: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875653
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875653%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875653: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875654
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875654%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875654: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875655
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875655%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875655: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875656
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875656%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875656: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875657
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875657%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875657: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875658
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875658%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875658: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875659
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875659%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875659: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875660
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875660%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875660: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875661
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875661%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875661: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875662
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875662%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875662: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875663
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875663%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875663: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875664
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875664%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875664: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875665
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875665%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875665: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875666
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875666%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875666: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875667
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875667%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875667: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875668
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875668%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875668: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875669
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875669%27 HTTP/1.1" 200 None
2026-01-28 20:00:52 [ayvens.fr] INFO: Scrape type for 1875669: 0
2026-01-28 20:00:52 [ayvens.fr] INFO: Found listing with ID: 1875670
2026-01-28 20:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875670%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875670: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875671
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875671%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875671: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875672
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875672%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875672: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875673
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875673%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875673: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875674
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875674%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875674: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875675
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875675%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875675: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875676
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875676%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875676: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875677
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875677%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875677: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875678
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875678%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875678: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875679
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875679%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875679: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875680
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875680%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875680: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875681
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875681%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875681: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875682
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875682%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875682: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875683
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875683%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875683: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875684
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875684%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875684: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875685
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875685%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875685: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875686
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875686%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875686: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875687
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875687%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875687: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875688
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875688%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875688: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875689
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875689%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875689: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875690
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875690%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875690: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875691
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875691%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875691: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875692
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875692%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875692: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875693
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875693%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875693: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875694
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875694%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875694: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875695
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875695%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875695: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875696
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875696%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875696: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875697
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875697%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875697: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875698
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875698%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875698: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875699
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875699%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875699: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875700
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875700%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875700: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875701
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875701%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875701: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875702
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875702%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875702: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875703
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875703%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875703: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875704
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875704%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875704: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875705
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875705%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875705: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Found listing with ID: 1875706
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875706%27 HTTP/1.1" 200 None
2026-01-28 20:00:53 [ayvens.fr] INFO: Scrape type for 1875706: 0
2026-01-28 20:00:53 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 100
2026-01-28 20:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875707
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875707%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875707: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875708
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875708%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875708: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875709
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875709%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875709: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875710
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875710%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875710: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875711
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875711%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875711: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875712
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875712%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875712: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875713
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875713%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875713: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875714
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875714%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875714: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875715
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875715%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875715: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875716
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875716%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875716: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875717
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875717%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875717: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875718
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875718%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875718: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875719
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875719%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875719: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875720
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875720%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875720: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875721
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875721%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875721: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875722
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875722%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875722: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875723
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875723%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875723: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875724
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875724%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875724: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875725
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875725%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875725: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875726
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875726%27 HTTP/1.1" 200 None
2026-01-28 20:00:55 [ayvens.fr] INFO: Scrape type for 1875726: 0
2026-01-28 20:00:55 [ayvens.fr] INFO: Found listing with ID: 1875727
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875727%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875727: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875728
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875728%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875728: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875729
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875729%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875729: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875730
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875730%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875730: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875731
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875731%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875731: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875732
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875732%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875732: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875733
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875733%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875733: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875734
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875734%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875734: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875735
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875735%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875735: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875736
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875736%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875736: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875737
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875737%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875737: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875738
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875738%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875738: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875739
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875739%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875739: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875740
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875740%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875740: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875741
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875741%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875741: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875742
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875742%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875742: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875743
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875743%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875743: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875744
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875744%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875744: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875745
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875745%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875745: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875746
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875746%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875746: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875747
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875747%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875747: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875748
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875748%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875748: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875749
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875749%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875749: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875750
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875750%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875750: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875751
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875751%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875751: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875752
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875752%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875752: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875753
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875753%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875753: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875754
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875754%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875754: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875755
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875755%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875755: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875756
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875756%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875756: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875757
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875757%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875757: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875758
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875758%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875758: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875759
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875759%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875759: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875760
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875760%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875760: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875761
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875761%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875761: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875762
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875762%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875762: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875763
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875763%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875763: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875764
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875764%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875764: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875765
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875765%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875765: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875766
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875766%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875766: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875767
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875767%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875767: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875768
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875768%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875768: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875769
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875769%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875769: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875770
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875770%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875770: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875771
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875771%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875771: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875772
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875772%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875772: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875773
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875773%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875773: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875774
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875774%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875774: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875775
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875775%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875775: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875776
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875776%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875776: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875777
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875777%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875777: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875778
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875778%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875778: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875779
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875779%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875779: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875780
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875780%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875780: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875781
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875781%27 HTTP/1.1" 200 None
2026-01-28 20:00:56 [ayvens.fr] INFO: Scrape type for 1875781: 0
2026-01-28 20:00:56 [ayvens.fr] INFO: Found listing with ID: 1875782
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875782%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875782: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875783
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875783%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875783: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875784
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875784%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875784: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875785
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875785%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875785: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875786
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875786%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875786: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875787
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875787%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875787: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875788
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875788%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875788: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875789
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875789%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875789: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875790
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875790%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875790: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875791
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875791%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875791: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875792
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875792%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875792: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875793
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875793%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875793: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875794
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875794%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875794: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875795
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875795%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875795: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875796
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875796%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875796: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875797
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875797%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875797: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875798
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875798%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875798: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875799
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875799%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875799: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875800
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875800%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875800: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875801
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875801%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875801: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875802
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875802%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875802: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875803
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875803%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875803: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875804
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875804%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875804: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875805
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875805%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875805: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Found listing with ID: 1875806
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875806%27 HTTP/1.1" 200 None
2026-01-28 20:00:57 [ayvens.fr] INFO: Scrape type for 1875806: 0
2026-01-28 20:00:57 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 200
2026-01-28 20:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875807
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875807%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875807: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875808
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875808%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875808: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875809
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875809%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875809: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875810
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875810%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875810: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875811
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875811%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875811: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875812
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875812%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875812: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875813
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875813%27 HTTP/1.1" 200 None
2026-01-28 20:01:01 [ayvens.fr] INFO: Scrape type for 1875813: 0
2026-01-28 20:01:01 [ayvens.fr] INFO: Found listing with ID: 1875814
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875814%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875814: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875815
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875815%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875815: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875816
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875816%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875816: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875817
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875817%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875817: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875818
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875818%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875818: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875819
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875819%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875819: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875820
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875820%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875820: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875821
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875821%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875821: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875822
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875822%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875822: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875823
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875823%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875823: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875824
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875824%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875824: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875825
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875825%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875825: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875826
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875826%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875826: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875827
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875827%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875827: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875828
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875828%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875828: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875829
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875829%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875829: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875830
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875830%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875830: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875831
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875831%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875831: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875832
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875832%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875832: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875833
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875833%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875833: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875834
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875834%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875834: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875835
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875835%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875835: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875836
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875836%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875836: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875837
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875837%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875837: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875838
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875838%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875838: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875839
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875839%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875839: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875840
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875840%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875840: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875841
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875841%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875841: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875842
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875842%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875842: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875843
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875843%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875843: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875844
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875844%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875844: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875845
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875845%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875845: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875846
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875846%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875846: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875847
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875847%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875847: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875848
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875848%27 HTTP/1.1" 200 None
2026-01-28 20:01:02 [ayvens.fr] INFO: Scrape type for 1875848: 0
2026-01-28 20:01:02 [ayvens.fr] INFO: Found listing with ID: 1875849
2026-01-28 20:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875849%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875849: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875850
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875850%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875850: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875851
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875851%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875851: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875852
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875852%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875852: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875853
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875853%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875853: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875854
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875854%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875854: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875855
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875855%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875855: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875856
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875856%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875856: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875857
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875857%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875857: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875858
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875858%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875858: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875859
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875859%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875859: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875860
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875860%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875860: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875861
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875861%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875861: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875862
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875862%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875862: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875863
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875863%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875863: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875864
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875864%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875864: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875865
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875865%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875865: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875866
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875866%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875866: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875867
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875867%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875867: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875868
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875868%27 HTTP/1.1" 200 None
2026-01-28 20:01:03 [ayvens.fr] INFO: Scrape type for 1875868: 0
2026-01-28 20:01:03 [ayvens.fr] INFO: Found listing with ID: 1875869
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875869%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875869: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875870
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875870%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875870: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875871
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875871%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875871: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875872
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875872%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875872: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875873
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875873%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875873: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875874
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875874%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875874: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875875
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875875%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875875: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875876
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875876%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875876: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875877
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875877%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875877: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875878
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875878%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875878: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875879
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875879%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875879: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875880
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875880%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875880: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875881
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875881%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875881: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875882
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875882%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875882: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875883
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875883%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875883: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875884
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875884%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875884: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875885
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875885%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875885: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875886
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875886%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875886: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875887
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875887%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875887: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875888
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875888%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875888: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875889
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875889%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875889: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875890
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875890%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875890: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875891
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875891%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875891: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875892
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875892%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875892: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875893
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875893%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875893: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875894
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875894%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875894: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875895
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875895%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875895: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875896
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875896%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875896: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875897
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875897%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875897: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875898
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875898%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875898: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875899
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875899%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875899: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875900
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875900%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875900: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875901
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875901%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875901: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875902
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875902%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875902: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875903
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875903%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875903: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875904
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875904%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875904: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875905
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875905%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875905: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Found listing with ID: 1875906
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875906%27 HTTP/1.1" 200 None
2026-01-28 20:01:04 [ayvens.fr] INFO: Scrape type for 1875906: 0
2026-01-28 20:01:04 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 300
2026-01-28 20:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875907
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875907%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875907: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875908
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875908%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875908: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875909
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875909%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875909: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875910
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875910%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875910: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875911
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875911%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875911: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875912
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875912%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875912: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875913
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875913%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875913: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875914
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875914%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875914: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875915
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875915%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875915: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875916
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875916%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875916: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875917
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875917%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875917: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875918
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875918%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875918: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875919
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875919%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875919: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875920
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875920%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875920: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875921
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875921%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875921: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875922
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875922%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875922: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875923
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875923%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875923: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875924
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875924%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875924: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875925
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875925%27 HTTP/1.1" 200 None
2026-01-28 20:01:06 [ayvens.fr] INFO: Scrape type for 1875925: 0
2026-01-28 20:01:06 [ayvens.fr] INFO: Found listing with ID: 1875926
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875926%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875926: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875927
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875927%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875927: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875928
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875928%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875928: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875929
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875929%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875929: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875930
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875930%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875930: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875931
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875931%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875931: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875932
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875932%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875932: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875933
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875933%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875933: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875934
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875934%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875934: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875935
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875935%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875935: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875936
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875936%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875936: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875937
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875937%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875937: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875938
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875938%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875938: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875939
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875939%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875939: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875940
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875940%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875940: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875941
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875941%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875941: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875942
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875942%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875942: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875943
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875943%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875943: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875944
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875944%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875944: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875945
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875945%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875945: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875946
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875946%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875946: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875947
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875947%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875947: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875948
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875948%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875948: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875949
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875949%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875949: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875950
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875950%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875950: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875951
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875951%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875951: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875952
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875952%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875952: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875953
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875953%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875953: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875954
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875954%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875954: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875955
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875955%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875955: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875956
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875956%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875956: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875957
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875957%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875957: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875958
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875958%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875958: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875959
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875959%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875959: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875960
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875960%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875960: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875961
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875961%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875961: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875962
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875962%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875962: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875963
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875963%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875963: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875964
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875964%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875964: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875965
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875965%27 HTTP/1.1" 200 None
2026-01-28 20:01:07 [ayvens.fr] INFO: Scrape type for 1875965: 0
2026-01-28 20:01:07 [ayvens.fr] INFO: Found listing with ID: 1875966
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875966%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875966: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875967
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875967%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875967: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875968
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875968%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875968: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875969
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875969%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875969: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875970
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875970%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875970: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875971
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875971%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875971: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875972
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875972%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875972: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875973
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875973%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875973: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875974
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875974%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875974: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875975
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875975%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875975: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875976
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875976%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875976: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875977
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875977%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875977: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875978
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875978%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875978: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875979
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875979%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875979: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875980
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875980%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875980: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875981
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875981%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875981: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875982
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875982%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875982: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875983
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875983%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875983: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875984
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875984%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875984: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875985
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875985%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875985: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875986
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875986%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875986: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875987
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875987%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875987: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875988
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875988%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875988: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875989
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875989%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875989: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875990
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875990%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875990: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875991
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875991%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875991: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875992
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875992%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875992: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875993
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875993%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875993: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875994
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875994%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875994: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875995
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875995%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875995: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875996
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875996%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875996: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875997
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875997%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875997: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875998
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875998%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875998: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1875999
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271875999%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1875999: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876000
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876000%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876000: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876001
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876001%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876001: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876002
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876002%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876002: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876003
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876003%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876003: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876004
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876004%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876004: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876005
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876005%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876005: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Found listing with ID: 1876006
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271876006%27 HTTP/1.1" 200 None
2026-01-28 20:01:08 [ayvens.fr] INFO: Scrape type for 1876006: 0
2026-01-28 20:01:08 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 400
2026-01-28 20:01:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:01:11 [ayvens.fr] INFO: Found listing with ID: 1877869
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877869%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [ayvens.fr] INFO: Scrape type for 1877869: 1
2026-01-28 20:01:11 [ayvens.fr] INFO: Extracting data for car ID: 1877869
2026-01-28 20:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b995a2f-bec5-5aa5-bfb3-820106ef9712 with identifier: 1877869
2026-01-28 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712 with scrape type 1
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/1.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/2.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/3.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/4.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/5.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/6.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/7.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/8.jpg not downloaded yet
2026-01-28 20:01:11 [ayvens.fr] INFO: Found listing with ID: 1877870
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877870%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [ayvens.fr] INFO: Scrape type for 1877870: 1
2026-01-28 20:01:11 [ayvens.fr] INFO: Extracting data for car ID: 1877870
2026-01-28 20:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 with identifier: 1877870
2026-01-28 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 with scrape type 1
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg not downloaded yet
2026-01-28 20:01:11 [ayvens.fr] INFO: Found listing with ID: 1877871
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877871%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [ayvens.fr] INFO: Scrape type for 1877871: 1
2026-01-28 20:01:11 [ayvens.fr] INFO: Extracting data for car ID: 1877871
2026-01-28 20:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8b88e88-956e-5d11-8d94-4fe650230bdf with identifier: 1877871
2026-01-28 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b88e88-956e-5d11-8d94-4fe650230bdf with scrape type 1
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg not downloaded yet
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg not downloaded yet
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg not downloaded yet
2026-01-28 20:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:11 [ayvens.fr] INFO: Found listing with ID: 1877872
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877872%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [ayvens.fr] INFO: Scrape type for 1877872: 1
2026-01-28 20:01:11 [ayvens.fr] INFO: Extracting data for car ID: 1877872
2026-01-28 20:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1edf096-08dd-53c1-b697-2092446f9023 with identifier: 1877872
2026-01-28 20:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1edf096-08dd-53c1-b697-2092446f9023 with scrape type 1
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/2.jpg not downloaded yet
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a4950>
2026-01-28 20:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/1.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c6410>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/4.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/3.jpg not downloaded yet
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/4.jpg not downloaded yet
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/5.jpg not downloaded yet
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45a9bd0>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/2.jpg saved to cache
2026-01-28 20:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4382a10>
2026-01-28 20:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/5.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4585a90>
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/3.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458b410>
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/7.jpg saved to cache
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/6.jpg not downloaded yet
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/7.jpg not downloaded yet
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454ed90>
2026-01-28 20:01:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/6.jpg saved to cache
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44fa210>
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg saved to cache
2026-01-28 20:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4547110>
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44f88d0>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4546510>
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fen-%252Ffbe50d5f34054e44a5684a4d4db3ef21%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/8.jpg saved to cache
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712
2026-01-28 20:01:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b995a2f-bec5-5aa5-bfb3-820106ef9712, skipping ID generation
2026-01-28 20:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712 with scrape type 1
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b995a2f-bec5-5aa5-bfb3-820106ef9712 from tracking dictionaries
2026-01-28 20:01:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b995a2f-bec5-5aa5-bfb3-820106ef9712 sending to next pipeline
2026-01-28 20:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6b995a2f-bec5-5aa5-bfb3-820106ef9712, identifier: 1877869
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/8.jpg not downloaded yet
2026-01-28 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6b995a2f-bec5-5aa5-bfb3-820106ef9712 with identifier: 1877869
2026-01-28 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6b995a2f-bec5-5aa5-bfb3-820106ef9712 with identifier: 1877869
2026-01-28 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6b995a2f-bec5-5aa5-bfb3-820106ef9712 spider: ayvens.fr
2026-01-28 20:01:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6b995a2f-bec5-5aa5-bfb3-820106ef9712 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': 'GRIS SHARK',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '6b995a2f-bec5-5aa5-bfb3-820106ef9712',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 45150,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319590,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269256,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311514,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 222530,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b995a2f-bec5-5aa5-bfb3-820106ef9712/6b995a2f-bec5-5aa5-bfb3-820106ef9712_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/en-/fbe50d5f34054e44a5684a4d4db3ef21/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-06-28',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo M 1.6 BlueHDi 120 S&S Business',
'transmission': 'manual',
'trim': 'Berlingo M 1.6 BlueHDi 120 S&S Business',
'vin': None,
'year': 2017}
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877869%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [ayvens.fr] INFO: Saving data for 1877869: {'created_time': 1769630476.649532, 'last_price_update_time': 1769630476.649545, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877869') HTTP/1.1" 204 0
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:16 [ayvens.fr] INFO: Found listing with ID: 1877873
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877873%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [ayvens.fr] INFO: Scrape type for 1877873: 1
2026-01-28 20:01:16 [ayvens.fr] INFO: Extracting data for car ID: 1877873
2026-01-28 20:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 670b164d-08fe-577b-b9b7-bb8c6d5da912 with identifier: 1877873
2026-01-28 20:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 670b164d-08fe-577b-b9b7-bb8c6d5da912 with scrape type 1
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/1.jpg not downloaded yet
2026-01-28 20:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/2.jpg not downloaded yet
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40a7a90>
2026-01-28 20:01:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406f210>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg saved to cache
2026-01-28 20:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414d850>
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/3.jpg not downloaded yet
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/4.jpg not downloaded yet
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419c490>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43218d0>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg saved to cache
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/5.jpg not downloaded yet
2026-01-28 20:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/6.jpg not downloaded yet
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/7.jpg not downloaded yet
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a7010>
2026-01-28 20:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg saved to cache
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429df50>
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg saved to cache
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4735d10>
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg saved to cache
2026-01-28 20:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40dac50>
2026-01-28 20:01:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F13263e0316d24f779aadd777b96e889c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg saved to cache
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5
2026-01-28 20:01:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5, skipping ID generation
2026-01-28 20:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 with scrape type 1
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 from tracking dictionaries
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 sending to next pipeline
2026-01-28 20:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5, identifier: 1877870
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45aa590>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg saved to cache
2026-01-28 20:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a6a90>
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 with identifier: 1877870
2026-01-28 20:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 with identifier: 1877870
2026-01-28 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 1.2 puretech 83ch s&s feel business', 'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business', 'price': 0, 'odometer': 78766, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-19', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 96, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '99945c27-6cf1-51b7-adbb-20cebfd1b8a5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 461856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 461856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 363902}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329365}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 263228}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 379999}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 367728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 385100}], 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 78766}
Failed validating None in schema:
False
On instance:
{'age_in_months': 71,
'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '99945c27-6cf1-51b7-adbb-20cebfd1b8a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 78766,
'odometer_in_km': 78766,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business',
'transmission': 'manual',
'trim': 'c3 1.2 puretech 83ch s&s feel business',
'vin': None,
'year': 2020}
2026-01-28 20:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 spider: ayvens.fr
2026-01-28 20:01:21 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 99945c27-6cf1-51b7-adbb-20cebfd1b8a5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 1.2 puretech 83ch s&s feel business', 'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business', 'price': 0, 'odometer': 78766, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-19', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 96, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '99945c27-6cf1-51b7-adbb-20cebfd1b8a5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 461856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 461856}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 363902}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329365}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 263228}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 379999}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 367728}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 385100}], 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 78766}
Failed validating None in schema:
False
On instance:
{'age_in_months': 71,
'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '99945c27-6cf1-51b7-adbb-20cebfd1b8a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 78766,
'odometer_in_km': 78766,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business',
'transmission': 'manual',
'trim': 'c3 1.2 puretech 83ch s&s feel business',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '99945c27-6cf1-51b7-adbb-20cebfd1b8a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 78766,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461856,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363902,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367728,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_99945c27-6cf1-51b7-adbb-20cebfd1b8a5/99945c27-6cf1-51b7-adbb-20cebfd1b8a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/13263e0316d24f779aadd777b96e889c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-19',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2020}
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877870%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [ayvens.fr] INFO: Saving data for 1877870: {'created_time': 1769630481.38094, 'last_price_update_time': 1769630481.380954, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877870') HTTP/1.1" 204 0
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/8.jpg not downloaded yet
2026-01-28 20:01:21 [ayvens.fr] INFO: Found listing with ID: 1877874
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877874%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [ayvens.fr] INFO: Scrape type for 1877874: 1
2026-01-28 20:01:21 [ayvens.fr] INFO: Extracting data for car ID: 1877874
2026-01-28 20:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6f71927-3821-5a7f-8483-68e1f1c3196e with identifier: 1877874
2026-01-28 20:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f71927-3821-5a7f-8483-68e1f1c3196e with scrape type 1
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/1.jpg not downloaded yet
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cfb90>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/2.jpg saved to cache
2026-01-28 20:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40db550>
2026-01-28 20:01:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/4.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41610d0>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/6.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414c590>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/3.jpg saved to cache
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/2.jpg not downloaded yet
2026-01-28 20:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/3.jpg not downloaded yet
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff17b50>
2026-01-28 20:01:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/5.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416e690>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg saved to cache
2026-01-28 20:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416dfd0>
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F7893182afdae473bbe1b8ab117a61ec5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg saved to cache
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8b88e88-956e-5d11-8d94-4fe650230bdf
2026-01-28 20:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8b88e88-956e-5d11-8d94-4fe650230bdf, skipping ID generation
2026-01-28 20:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8b88e88-956e-5d11-8d94-4fe650230bdf with scrape type 1
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8b88e88-956e-5d11-8d94-4fe650230bdf from tracking dictionaries
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8b88e88-956e-5d11-8d94-4fe650230bdf sending to next pipeline
2026-01-28 20:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f8b88e88-956e-5d11-8d94-4fe650230bdf, identifier: 1877871
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41637d0>
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/1.jpg saved to cache
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f8b88e88-956e-5d11-8d94-4fe650230bdf with identifier: 1877871
2026-01-28 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f8b88e88-956e-5d11-8d94-4fe650230bdf with identifier: 1877871
2026-01-28 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 82ch s&s feel business r', 'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel business r', 'price': 0, 'odometer': 73008, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-21', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 96, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f8b88e88-956e-5d11-8d94-4fe650230bdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 387092}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 387092}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 397822}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 285956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 326763}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338335}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317555}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 304163}], 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 73008}
Failed validating None in schema:
False
On instance:
{'age_in_months': 71,
'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'f8b88e88-956e-5d11-8d94-4fe650230bdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 73008,
'odometer_in_km': 73008,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-21',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel business r',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 82ch s&s feel business r',
'vin': None,
'year': 2020}
2026-01-28 20:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f8b88e88-956e-5d11-8d94-4fe650230bdf spider: ayvens.fr
2026-01-28 20:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: f8b88e88-956e-5d11-8d94-4fe650230bdf due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 82ch s&s feel business r', 'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel business r', 'price': 0, 'odometer': 73008, 'odometer_reading_unit': 'km', 'registration_date': '2020-02-21', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 96, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f8b88e88-956e-5d11-8d94-4fe650230bdf', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 387092}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 387092}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 397822}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 285956}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 326763}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338335}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317555}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 304163}], 'current_year_diff': 6, 'age_in_months': 71, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 73008}
Failed validating None in schema:
False
On instance:
{'age_in_months': 71,
'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'f8b88e88-956e-5d11-8d94-4fe650230bdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 73008,
'odometer_in_km': 73008,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-21',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel business r',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 82ch s&s feel business r',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'f8b88e88-956e-5d11-8d94-4fe650230bdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 73008,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338335,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317555,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8b88e88-956e-5d11-8d94-4fe650230bdf/f8b88e88-956e-5d11-8d94-4fe650230bdf_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304163,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/7893182afdae473bbe1b8ab117a61ec5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-21',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.2 PureTech 82ch S&S Feel Business R',
'transmission': 'manual',
'trim': 'C3 Ste 1.2 PureTech 82ch S&S Feel Business R',
'vin': None,
'year': 2020}
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877871%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [ayvens.fr] INFO: Saving data for 1877871: {'created_time': 1769630484.864285, 'last_price_update_time': 1769630484.864298, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877871') HTTP/1.1" 204 0
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/4.jpg not downloaded yet
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/5.jpg not downloaded yet
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4464210>
2026-01-28 20:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/7.jpg saved to cache
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/6.jpg not downloaded yet
2026-01-28 20:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/7.jpg not downloaded yet
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d35d0>
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F528f41e602614fdcbddfc4ab2a25e04f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/8.jpg saved to cache
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1edf096-08dd-53c1-b697-2092446f9023
2026-01-28 20:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1edf096-08dd-53c1-b697-2092446f9023, skipping ID generation
2026-01-28 20:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1edf096-08dd-53c1-b697-2092446f9023 with scrape type 1
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a1edf096-08dd-53c1-b697-2092446f9023 from tracking dictionaries
2026-01-28 20:01:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1edf096-08dd-53c1-b697-2092446f9023 sending to next pipeline
2026-01-28 20:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a1edf096-08dd-53c1-b697-2092446f9023, identifier: 1877872
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4418610>
2026-01-28 20:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/4.jpg saved to cache
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaed410>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/5.jpg saved to cache
2026-01-28 20:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e6ad0>
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/1.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44bec50>
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/3.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46b7350>
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/2.jpg saved to cache
2026-01-28 20:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44855d0>
2026-01-28 20:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/6.jpg saved to cache
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a1edf096-08dd-53c1-b697-2092446f9023 with identifier: 1877872
2026-01-28 20:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a1edf096-08dd-53c1-b697-2092446f9023 with identifier: 1877872
2026-01-28 20:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a1edf096-08dd-53c1-b697-2092446f9023 with identifier: 1877872 to the API
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'a1edf096-08dd-53c1-b697-2092446f9023',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 109549,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272479,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338441,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1edf096-08dd-53c1-b697-2092446f9023/a1edf096-08dd-53c1-b697-2092446f9023_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243559,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/528f41e602614fdcbddfc4ab2a25e04f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-28',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R',
'vin': None,
'year': 2019}
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877872%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [ayvens.fr] INFO: Saving data for 1877872: {'created_time': 1769630488.848646, 'last_price_update_time': 1769630488.848657, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877872') HTTP/1.1" 204 0
2026-01-28 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/8.jpg not downloaded yet
2026-01-28 20:01:28 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 9 pages/min), scraped 4 items (at 4 items/min)
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c7bd0>
2026-01-28 20:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/7.jpg saved to cache
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:29 [ayvens.fr] INFO: Found listing with ID: 1877875
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877875%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [ayvens.fr] INFO: Scrape type for 1877875: 1
2026-01-28 20:01:29 [ayvens.fr] INFO: Extracting data for car ID: 1877875
2026-01-28 20:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baad5edc-5d31-5752-b762-08278a41b40c with identifier: 1877875
2026-01-28 20:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baad5edc-5d31-5752-b762-08278a41b40c with scrape type 1
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/1.jpg not downloaded yet
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/2.jpg not downloaded yet
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4588e90>
2026-01-28 20:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/1.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4323b10>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/2.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/3.jpg not downloaded yet
2026-01-28 20:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff50dd0>
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffj-%252F20066da730784e9bb98b1356b7cdf8dd%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/8.jpg saved to cache
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 670b164d-08fe-577b-b9b7-bb8c6d5da912
2026-01-28 20:01:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 670b164d-08fe-577b-b9b7-bb8c6d5da912, skipping ID generation
2026-01-28 20:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 670b164d-08fe-577b-b9b7-bb8c6d5da912 with scrape type 1
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 670b164d-08fe-577b-b9b7-bb8c6d5da912 from tracking dictionaries
2026-01-28 20:01:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 670b164d-08fe-577b-b9b7-bb8c6d5da912 sending to next pipeline
2026-01-28 20:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 670b164d-08fe-577b-b9b7-bb8c6d5da912, identifier: 1877873
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45884d0>
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/3.jpg saved to cache
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44725d0>
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/4.jpg saved to cache
2026-01-28 20:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429fad0>
2026-01-28 20:01:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/5.jpg saved to cache
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/4.jpg not downloaded yet
2026-01-28 20:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 670b164d-08fe-577b-b9b7-bb8c6d5da912 with identifier: 1877873
2026-01-28 20:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 670b164d-08fe-577b-b9b7-bb8c6d5da912 with identifier: 1877873
2026-01-28 20:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 670b164d-08fe-577b-b9b7-bb8c6d5da912 with identifier: 1877873 to the API
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '670b164d-08fe-577b-b9b7-bb8c6d5da912',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 78709,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431960,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329736,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300101,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329176,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_670b164d-08fe-577b-b9b7-bb8c6d5da912/670b164d-08fe-577b-b9b7-bb8c6d5da912_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fj-/20066da730784e9bb98b1356b7cdf8dd/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-08-02',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R E6.d-TEMP',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R E6.d-TEMP',
'vin': None,
'year': 2019}
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877873%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [ayvens.fr] INFO: Saving data for 1877873: {'created_time': 1769630492.811363, 'last_price_update_time': 1769630492.811377, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877873') HTTP/1.1" 204 0
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/5.jpg not downloaded yet
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419c150>
2026-01-28 20:01:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/6.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a7190>
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/7.jpg saved to cache
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/6.jpg not downloaded yet
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/7.jpg not downloaded yet
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/8.jpg not downloaded yet
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:33 [ayvens.fr] INFO: Found listing with ID: 1877876
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877876%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [ayvens.fr] INFO: Scrape type for 1877876: 1
2026-01-28 20:01:34 [ayvens.fr] INFO: Extracting data for car ID: 1877876
2026-01-28 20:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cef38dff-4889-5fb7-b1be-6b3cbee2f086 with identifier: 1877876
2026-01-28 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef38dff-4889-5fb7-b1be-6b3cbee2f086 with scrape type 1
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/1.jpg not downloaded yet
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/2.jpg not downloaded yet
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414ec50>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F06ab56e05d164c5faf3c5ac13957a0b6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/8.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6f71927-3821-5a7f-8483-68e1f1c3196e
2026-01-28 20:01:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6f71927-3821-5a7f-8483-68e1f1c3196e, skipping ID generation
2026-01-28 20:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6f71927-3821-5a7f-8483-68e1f1c3196e with scrape type 1
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e6f71927-3821-5a7f-8483-68e1f1c3196e from tracking dictionaries
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6f71927-3821-5a7f-8483-68e1f1c3196e sending to next pipeline
2026-01-28 20:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e6f71927-3821-5a7f-8483-68e1f1c3196e, identifier: 1877874
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e5d90>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/1.jpg saved to cache
2026-01-28 20:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407d750>
2026-01-28 20:01:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/2.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf164a50>
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/3.jpg saved to cache
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/3.jpg not downloaded yet
2026-01-28 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e6f71927-3821-5a7f-8483-68e1f1c3196e with identifier: 1877874
2026-01-28 20:01:35 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e6f71927-3821-5a7f-8483-68e1f1c3196e with identifier: 1877874
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 130897 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130897
2026-01-28 20:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: e6f71927-3821-5a7f-8483-68e1f1c3196e spider: ayvens.fr
2026-01-28 20:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: e6f71927-3821-5a7f-8483-68e1f1c3196e due to rule: high_mileage_for_make.json, error: 130897 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
130897
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'e6f71927-3821-5a7f-8483-68e1f1c3196e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208 BUSINESS R',
'odometer': 130897,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277029,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 243251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308483,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 181627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6f71927-3821-5a7f-8483-68e1f1c3196e/e6f71927-3821-5a7f-8483-68e1f1c3196e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410008,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/06ab56e05d164c5faf3c5ac13957a0b6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-06',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 208 BUSINESS R 208 Business R 1.5 BlueHDi 100ch S&S Active',
'transmission': 'manual',
'trim': '208 Business R 1.5 BlueHDi 100ch S&S Active',
'vin': None,
'year': 2022}
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877874%27 HTTP/1.1" 200 None
2026-01-28 20:01:35 [ayvens.fr] INFO: Saving data for 1877874: {'created_time': 1769630495.947725, 'last_price_update_time': 1769630495.947736, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877874') HTTP/1.1" 204 0
2026-01-28 20:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/4.jpg not downloaded yet
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/5.jpg not downloaded yet
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/6.jpg not downloaded yet
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/7.jpg not downloaded yet
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/8.jpg not downloaded yet
2026-01-28 20:01:36 [ayvens.fr] INFO: Found listing with ID: 1877877
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877877%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [ayvens.fr] INFO: Scrape type for 1877877: 1
2026-01-28 20:01:36 [ayvens.fr] INFO: Extracting data for car ID: 1877877
2026-01-28 20:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee466780-551f-5402-9b84-afc0b7fd1444 with identifier: 1877877
2026-01-28 20:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee466780-551f-5402-9b84-afc0b7fd1444 with scrape type 1
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg not downloaded yet
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b9190>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/4.jpg saved to cache
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg not downloaded yet
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c5f35b50>
2026-01-28 20:01:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/5.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4086690>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/8.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4204090>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/6.jpg saved to cache
2026-01-28 20:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44718d0>
2026-01-28 20:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F8479070c2be44cf2b66d927591e605ed%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/7.jpg saved to cache
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item baad5edc-5d31-5752-b762-08278a41b40c
2026-01-28 20:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baad5edc-5d31-5752-b762-08278a41b40c, skipping ID generation
2026-01-28 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item baad5edc-5d31-5752-b762-08278a41b40c with scrape type 1
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item baad5edc-5d31-5752-b762-08278a41b40c from tracking dictionaries
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baad5edc-5d31-5752-b762-08278a41b40c sending to next pipeline
2026-01-28 20:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: baad5edc-5d31-5752-b762-08278a41b40c, identifier: 1877875
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg not downloaded yet
2026-01-28 20:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: baad5edc-5d31-5752-b762-08278a41b40c with identifier: 1877875
2026-01-28 20:01:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: baad5edc-5d31-5752-b762-08278a41b40c with identifier: 1877875
2026-01-28 20:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: baad5edc-5d31-5752-b762-08278a41b40c spider: ayvens.fr
2026-01-28 20:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: baad5edc-5d31-5752-b762-08278a41b40c due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'baad5edc-5d31-5752-b762-08278a41b40c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 36734,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351434,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baad5edc-5d31-5752-b762-08278a41b40c/baad5edc-5d31-5752-b762-08278a41b40c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/8479070c2be44cf2b66d927591e605ed/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-16',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio Réversible 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877875%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [ayvens.fr] INFO: Saving data for 1877875: {'created_time': 1769630498.477253, 'last_price_update_time': 1769630498.477266, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877875') HTTP/1.1" 204 0
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg not downloaded yet
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg not downloaded yet
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg not downloaded yet
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg not downloaded yet
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg not downloaded yet
2026-01-28 20:01:38 [ayvens.fr] INFO: Found listing with ID: 1877878
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877878%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [ayvens.fr] INFO: Scrape type for 1877878: 1
2026-01-28 20:01:38 [ayvens.fr] INFO: Extracting data for car ID: 1877878
2026-01-28 20:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac with identifier: 1877878
2026-01-28 20:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac with scrape type 1
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg not downloaded yet
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1a2a10>
2026-01-28 20:01:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/3.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d0250>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/6.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4329ed0>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/4.jpg saved to cache
2026-01-28 20:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4348f50>
2026-01-28 20:01:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/5.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4161d90>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/7.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg not downloaded yet
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfb33c10>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/1.jpg saved to cache
2026-01-28 20:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41baf10>
2026-01-28 20:01:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/2.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a4d90>
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F4f6ab4b5219f486493da1c7e7762d099%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/8.jpg saved to cache
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cef38dff-4889-5fb7-b1be-6b3cbee2f086
2026-01-28 20:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cef38dff-4889-5fb7-b1be-6b3cbee2f086, skipping ID generation
2026-01-28 20:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cef38dff-4889-5fb7-b1be-6b3cbee2f086 with scrape type 1
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cef38dff-4889-5fb7-b1be-6b3cbee2f086 from tracking dictionaries
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cef38dff-4889-5fb7-b1be-6b3cbee2f086 sending to next pipeline
2026-01-28 20:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cef38dff-4889-5fb7-b1be-6b3cbee2f086, identifier: 1877876
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg not downloaded yet
2026-01-28 20:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cef38dff-4889-5fb7-b1be-6b3cbee2f086 with identifier: 1877876
2026-01-28 20:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cef38dff-4889-5fb7-b1be-6b3cbee2f086 with identifier: 1877876
2026-01-28 20:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: cef38dff-4889-5fb7-b1be-6b3cbee2f086 with identifier: 1877876 to the API
2026-01-28 20:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': None,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'cef38dff-4889-5fb7-b1be-6b3cbee2f086',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 88956,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 475805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315974,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313759,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 228303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cef38dff-4889-5fb7-b1be-6b3cbee2f086/cef38dff-4889-5fb7-b1be-6b3cbee2f086_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/4f6ab4b5219f486493da1c7e7762d099/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-05',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Business R - '
'TRANSFO 5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S BVM 6 Feel Business R - TRANSFO 5 '
'PLACES / 5 SEATS OK + CERTIF OK',
'vin': None,
'year': 2020}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877876%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [ayvens.fr] INFO: Saving data for 1877876: {'created_time': 1769630502.209046, 'last_price_update_time': 1769630502.209056, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877876') HTTP/1.1" 204 0
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg not downloaded yet
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg not downloaded yet
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg not downloaded yet
2026-01-28 20:01:42 [ayvens.fr] INFO: Found listing with ID: 1877879
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877879%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [ayvens.fr] INFO: Scrape type for 1877879: 1
2026-01-28 20:01:42 [ayvens.fr] INFO: Extracting data for car ID: 1877879
2026-01-28 20:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24c5077d-ca72-5df5-8b4f-52f0c77898b0 with identifier: 1877879
2026-01-28 20:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0 with scrape type 1
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/1.jpg not downloaded yet
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e1990>
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg saved to cache
2026-01-28 20:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412a310>
2026-01-28 20:01:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45aae50>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b2550>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg saved to cache
2026-01-28 20:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412a250>
2026-01-28 20:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/2.jpg not downloaded yet
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418d190>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454ec50>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg saved to cache
2026-01-28 20:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44f8710>
2026-01-28 20:01:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F601074f54f27458880655730723a5b9a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg saved to cache
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ee466780-551f-5402-9b84-afc0b7fd1444
2026-01-28 20:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ee466780-551f-5402-9b84-afc0b7fd1444, skipping ID generation
2026-01-28 20:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee466780-551f-5402-9b84-afc0b7fd1444 with scrape type 1
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ee466780-551f-5402-9b84-afc0b7fd1444 from tracking dictionaries
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ee466780-551f-5402-9b84-afc0b7fd1444 sending to next pipeline
2026-01-28 20:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ee466780-551f-5402-9b84-afc0b7fd1444, identifier: 1877877
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/3.jpg not downloaded yet
2026-01-28 20:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ee466780-551f-5402-9b84-afc0b7fd1444 with identifier: 1877877
2026-01-28 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ee466780-551f-5402-9b84-afc0b7fd1444 with identifier: 1877877
2026-01-28 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 sté 1.2 puretech 82ch s&s feel business r e6.d - transfo 5 places / 5 seats ok + certif ok', 'title': 'citroën c3 c3 sté 1.2 puretech 82ch s&s feel business r e6.d - transfo 5 places / 5 seats ok + certif ok', 'price': 0, 'odometer': 97311, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-09', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 96, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ee466780-551f-5402-9b84-afc0b7fd1444', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 618591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 618591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 429850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 381321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 319830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 274528}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 432780}], 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 97311}
Failed validating None in schema:
False
On instance:
{'age_in_months': 67,
'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'ee466780-551f-5402-9b84-afc0b7fd1444',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 97311,
'odometer_in_km': 97311,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-09',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 sté 1.2 puretech 82ch s&s feel business r '
'e6.d - transfo 5 places / 5 seats ok + certif ok',
'transmission': 'manual',
'trim': 'c3 sté 1.2 puretech 82ch s&s feel business r e6.d - transfo '
'5 places / 5 seats ok + certif ok',
'vin': None,
'year': 2020}
2026-01-28 20:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ee466780-551f-5402-9b84-afc0b7fd1444 spider: ayvens.fr
2026-01-28 20:01:45 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: ee466780-551f-5402-9b84-afc0b7fd1444 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 sté 1.2 puretech 82ch s&s feel business r e6.d - transfo 5 places / 5 seats ok + certif ok', 'title': 'citroën c3 c3 sté 1.2 puretech 82ch s&s feel business r e6.d - transfo 5 places / 5 seats ok + certif ok', 'price': 0, 'odometer': 97311, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-09', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 96, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'ee466780-551f-5402-9b84-afc0b7fd1444', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 618591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 618591}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 429850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 381321}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 319830}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 274528}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 432780}], 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 97311}
Failed validating None in schema:
False
On instance:
{'age_in_months': 67,
'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'ee466780-551f-5402-9b84-afc0b7fd1444',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 97311,
'odometer_in_km': 97311,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-09',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 sté 1.2 puretech 82ch s&s feel business r '
'e6.d - transfo 5 places / 5 seats ok + certif ok',
'transmission': 'manual',
'trim': 'c3 sté 1.2 puretech 82ch s&s feel business r e6.d - transfo '
'5 places / 5 seats ok + certif ok',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 96,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'ee466780-551f-5402-9b84-afc0b7fd1444',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 97311,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 618591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381321,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 274528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ee466780-551f-5402-9b84-afc0b7fd1444/ee466780-551f-5402-9b84-afc0b7fd1444_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/601074f54f27458880655730723a5b9a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-09',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.2 PureTech 82ch S&S Feel Business R E6.d - '
'TRANSFO 5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Sté 1.2 PureTech 82ch S&S Feel Business R E6.d - TRANSFO 5 PLACES '
'/ 5 SEATS OK + CERTIF OK',
'vin': None,
'year': 2020}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877877%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [ayvens.fr] INFO: Saving data for 1877877: {'created_time': 1769630505.552543, 'last_price_update_time': 1769630505.552555, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877877') HTTP/1.1" 204 0
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/4.jpg not downloaded yet
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/5.jpg not downloaded yet
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/6.jpg not downloaded yet
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/7.jpg not downloaded yet
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/8.jpg not downloaded yet
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4281bd0>
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:46 [ayvens.fr] INFO: Found listing with ID: 1877880
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877880%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [ayvens.fr] INFO: Scrape type for 1877880: 1
2026-01-28 20:01:46 [ayvens.fr] INFO: Extracting data for car ID: 1877880
2026-01-28 20:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0515afbf-87d5-5c75-ad1b-2e591f979c95 with identifier: 1877880
2026-01-28 20:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0515afbf-87d5-5c75-ad1b-2e591f979c95 with scrape type 1
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg not downloaded yet
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46b6b50>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c6ad0>
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg saved to cache
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg not downloaded yet
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg not downloaded yet
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4320110>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4391190>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg saved to cache
2026-01-28 20:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44840d0>
2026-01-28 20:01:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a4ad0>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e2010>
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F3a839775983f4cafb9c6be403c79ec0f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg saved to cache
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac
2026-01-28 20:01:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac, skipping ID generation
2026-01-28 20:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac with scrape type 1
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac from tracking dictionaries
2026-01-28 20:01:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 182127f3-0a5e-5505-8bfa-c043c4c2d5ac sending to next pipeline
2026-01-28 20:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac, identifier: 1877878
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac with identifier: 1877878
2026-01-28 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac with identifier: 1877878
2026-01-28 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': None, 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 1.2 puretech 110ch s&s shine eat6', 'title': 'citroën c3 c3 1.2 puretech 110ch s&s shine eat6', 'price': 0, 'odometer': 60569, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-24', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 133, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '182127f3-0a5e-5505-8bfa-c043c4c2d5ac', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 442390}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 442390}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 448628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411093}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 388850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 342731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 363842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 255926}], 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 60569}
Failed validating None in schema:
False
On instance:
{'age_in_months': 59,
'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '182127f3-0a5e-5505-8bfa-c043c4c2d5ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 60569,
'odometer_in_km': 60569,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 1.2 puretech 110ch s&s shine eat6',
'transmission': 'automatic',
'trim': 'c3 1.2 puretech 110ch s&s shine eat6',
'vin': None,
'year': 2021}
2026-01-28 20:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac spider: ayvens.fr
2026-01-28 20:01:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 182127f3-0a5e-5505-8bfa-c043c4c2d5ac due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': None, 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 1.2 puretech 110ch s&s shine eat6', 'title': 'citroën c3 c3 1.2 puretech 110ch s&s shine eat6', 'price': 0, 'odometer': 60569, 'odometer_reading_unit': 'km', 'registration_date': '2021-02-24', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 133, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '182127f3-0a5e-5505-8bfa-c043c4c2d5ac', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 442390}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 442390}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 448628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411093}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 388850}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 342731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 363842}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 255926}], 'current_year_diff': 5, 'age_in_months': 59, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 60569}
Failed validating None in schema:
False
On instance:
{'age_in_months': 59,
'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '182127f3-0a5e-5505-8bfa-c043c4c2d5ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 60569,
'odometer_in_km': 60569,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 1.2 puretech 110ch s&s shine eat6',
'transmission': 'automatic',
'trim': 'c3 1.2 puretech 110ch s&s shine eat6',
'vin': None,
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '182127f3-0a5e-5505-8bfa-c043c4c2d5ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 60569,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442390,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 448628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_182127f3-0a5e-5505-8bfa-c043c4c2d5ac/182127f3-0a5e-5505-8bfa-c043c4c2d5ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255926,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/3a839775983f4cafb9c6be403c79ec0f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-24',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 110ch S&S Shine EAT6',
'transmission': 'automatic',
'trim': 'C3 1.2 PureTech 110ch S&S Shine EAT6',
'vin': None,
'year': 2021}
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877878%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [ayvens.fr] INFO: Saving data for 1877878: {'created_time': 1769630509.027808, 'last_price_update_time': 1769630509.027822, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877878') HTTP/1.1" 204 0
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg not downloaded yet
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg not downloaded yet
2026-01-28 20:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4382f50>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/2.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43814d0>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/3.jpg saved to cache
2026-01-28 20:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452bf10>
2026-01-28 20:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/4.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg not downloaded yet
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg not downloaded yet
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419ed90>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/1.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e5a10>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/6.jpg saved to cache
2026-01-28 20:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44fbd10>
2026-01-28 20:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/5.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c4d50>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/7.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c69d0>
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F22b390b894f8485593ebfa3f0cf761c4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/8.jpg saved to cache
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0
2026-01-28 20:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24c5077d-ca72-5df5-8b4f-52f0c77898b0, skipping ID generation
2026-01-28 20:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0 with scrape type 1
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 24c5077d-ca72-5df5-8b4f-52f0c77898b0 from tracking dictionaries
2026-01-28 20:01:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24c5077d-ca72-5df5-8b4f-52f0c77898b0 sending to next pipeline
2026-01-28 20:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 24c5077d-ca72-5df5-8b4f-52f0c77898b0, identifier: 1877879
2026-01-28 20:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 24c5077d-ca72-5df5-8b4f-52f0c77898b0 with identifier: 1877879
2026-01-28 20:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 24c5077d-ca72-5df5-8b4f-52f0c77898b0 with identifier: 1877879
2026-01-28 20:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 24c5077d-ca72-5df5-8b4f-52f0c77898b0 with identifier: 1877879 to the API
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '24c5077d-ca72-5df5-8b4f-52f0c77898b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 116771,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 490814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314481,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24c5077d-ca72-5df5-8b4f-52f0c77898b0/24c5077d-ca72-5df5-8b4f-52f0c77898b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 234536,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/22b390b894f8485593ebfa3f0cf761c4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R - TRANSFO 5 '
'PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Ste 1.5 BlueHDi 100ch S&S Feel Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2020}
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877879%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [ayvens.fr] INFO: Saving data for 1877879: {'created_time': 1769630512.55358, 'last_price_update_time': 1769630512.553591, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877879') HTTP/1.1" 204 0
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg not downloaded yet
2026-01-28 20:01:52 [ayvens.fr] INFO: Found listing with ID: 1877881
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877881%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [ayvens.fr] INFO: Scrape type for 1877881: 1
2026-01-28 20:01:52 [ayvens.fr] INFO: Extracting data for car ID: 1877881
2026-01-28 20:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64146edb-736b-56da-ae00-acd16f56669f with identifier: 1877881
2026-01-28 20:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64146edb-736b-56da-ae00-acd16f56669f with scrape type 1
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/1.jpg not downloaded yet
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/2.jpg not downloaded yet
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/3.jpg not downloaded yet
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/4.jpg not downloaded yet
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/5.jpg not downloaded yet
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/6.jpg not downloaded yet
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaeff10>
2026-01-28 20:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/7.jpg not downloaded yet
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4336b10>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg saved to cache
2026-01-28 20:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419e9d0>
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a5fd0>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4155510>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg saved to cache
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/8.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [ayvens.fr] INFO: Found listing with ID: 1877882
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877882%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [ayvens.fr] INFO: Scrape type for 1877882: 1
2026-01-28 20:01:54 [ayvens.fr] INFO: Extracting data for car ID: 1877882
2026-01-28 20:01:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df493e91-9df3-5c24-ab97-ab9f4edca0dc with identifier: 1877882
2026-01-28 20:01:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df493e91-9df3-5c24-ab97-ab9f4edca0dc with scrape type 1
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg not downloaded yet
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg not downloaded yet
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg not downloaded yet
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg not downloaded yet
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43814d0>
2026-01-28 20:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a5c90>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg not downloaded yet
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg not downloaded yet
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4376850>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/1.jpg saved to cache
2026-01-28 20:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417f510>
2026-01-28 20:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/2.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43284d0>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/4.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44bf710>
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F5ad5fa2c04b34ac18a775d3e770c70d9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg saved to cache
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0515afbf-87d5-5c75-ad1b-2e591f979c95
2026-01-28 20:01:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0515afbf-87d5-5c75-ad1b-2e591f979c95, skipping ID generation
2026-01-28 20:01:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0515afbf-87d5-5c75-ad1b-2e591f979c95 with scrape type 1
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0515afbf-87d5-5c75-ad1b-2e591f979c95 from tracking dictionaries
2026-01-28 20:01:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0515afbf-87d5-5c75-ad1b-2e591f979c95 sending to next pipeline
2026-01-28 20:01:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0515afbf-87d5-5c75-ad1b-2e591f979c95, identifier: 1877880
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b53d0>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/3.jpg saved to cache
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45bb0d0>
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/5.jpg saved to cache
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0515afbf-87d5-5c75-ad1b-2e591f979c95 with identifier: 1877880
2026-01-28 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0515afbf-87d5-5c75-ad1b-2e591f979c95 with identifier: 1877880
2026-01-28 20:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': 'e-208 business r', 'trim': '208 business r e-208 136ch active - transfo 5 places / 5 seats ok + certif ok', 'title': 'peugeot e-208 business r 208 business r e-208 136ch active - transfo 5 places / 5 seats ok + certif ok', 'price': 0, 'odometer': 18727, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-25', 'year': 2020, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '0515afbf-87d5-5c75-ad1b-2e591f979c95', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 439608}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 439608}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 474500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338610}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339639}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 298916}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 253800}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 341149}], 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot e-208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 18727} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '0515afbf-87d5-5c75-ad1b-2e591f979c95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot e-208 business r',
'model': 'e-208 business r',
'odometer': 18727,
'odometer_in_km': 18727,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot e-208 business r 208 business r e-208 136ch active '
'- transfo 5 places / 5 seats ok + certif ok',
'transmission': 'automatic',
'trim': '208 business r e-208 136ch active - transfo 5 places / 5 '
'seats ok + certif ok',
'vin': None,
'year': 2020}
2026-01-28 20:01:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 0515afbf-87d5-5c75-ad1b-2e591f979c95 spider: ayvens.fr
2026-01-28 20:01:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 0515afbf-87d5-5c75-ad1b-2e591f979c95 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': 'e-208 business r', 'trim': '208 business r e-208 136ch active - transfo 5 places / 5 seats ok + certif ok', 'title': 'peugeot e-208 business r 208 business r e-208 136ch active - transfo 5 places / 5 seats ok + certif ok', 'price': 0, 'odometer': 18727, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-25', 'year': 2020, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '0515afbf-87d5-5c75-ad1b-2e591f979c95', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 439608}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 439608}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 474500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338610}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339639}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 298916}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 253800}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 341149}], 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot e-208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 18727} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '0515afbf-87d5-5c75-ad1b-2e591f979c95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot e-208 business r',
'model': 'e-208 business r',
'odometer': 18727,
'odometer_in_km': 18727,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot e-208 business r 208 business r e-208 136ch active '
'- transfo 5 places / 5 seats ok + certif ok',
'transmission': 'automatic',
'trim': '208 business r e-208 136ch active - transfo 5 places / 5 '
'seats ok + certif ok',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': '0515afbf-87d5-5c75-ad1b-2e591f979c95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208 BUSINESS R',
'odometer': 18727,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338610,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339639,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0515afbf-87d5-5c75-ad1b-2e591f979c95/0515afbf-87d5-5c75-ad1b-2e591f979c95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/5ad5fa2c04b34ac18a775d3e770c70d9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-208 BUSINESS R 208 Business R e-208 136ch Active - '
'TRANSFO 5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'automatic',
'trim': '208 Business R e-208 136ch Active - TRANSFO 5 PLACES / 5 SEATS OK + '
'CERTIF OK',
'vin': None,
'year': 2020}
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877880%27 HTTP/1.1" 200 None
2026-01-28 20:01:57 [ayvens.fr] INFO: Saving data for 1877880: {'created_time': 1769630517.910192, 'last_price_update_time': 1769630517.910203, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877880') HTTP/1.1" 204 0
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg not downloaded yet
2026-01-28 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:57 [ayvens.fr] INFO: Found listing with ID: 1877883
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877883%27 HTTP/1.1" 200 None
2026-01-28 20:01:57 [ayvens.fr] INFO: Scrape type for 1877883: 1
2026-01-28 20:01:57 [ayvens.fr] INFO: Extracting data for car ID: 1877883
2026-01-28 20:01:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca049ab-8186-51b7-986d-d1fa709e4432 with identifier: 1877883
2026-01-28 20:01:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca049ab-8186-51b7-986d-d1fa709e4432 with scrape type 1
2026-01-28 20:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/1.jpg not downloaded yet
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/2.jpg not downloaded yet
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/3.jpg not downloaded yet
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/4.jpg not downloaded yet
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/5.jpg not downloaded yet
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40caa10>
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/7.jpg saved to cache
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/6.jpg not downloaded yet
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c443efd0>
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/8.jpg saved to cache
2026-01-28 20:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418f790>
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffh-%252F35e798854d194103995aede16de59505%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/6.jpg saved to cache
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64146edb-736b-56da-ae00-acd16f56669f
2026-01-28 20:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64146edb-736b-56da-ae00-acd16f56669f, skipping ID generation
2026-01-28 20:01:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64146edb-736b-56da-ae00-acd16f56669f with scrape type 1
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 64146edb-736b-56da-ae00-acd16f56669f from tracking dictionaries
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64146edb-736b-56da-ae00-acd16f56669f sending to next pipeline
2026-01-28 20:01:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 64146edb-736b-56da-ae00-acd16f56669f, identifier: 1877881
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/7.jpg not downloaded yet
2026-01-28 20:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 64146edb-736b-56da-ae00-acd16f56669f with identifier: 1877881
2026-01-28 20:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 64146edb-736b-56da-ae00-acd16f56669f with identifier: 1877881
2026-01-28 20:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 64146edb-736b-56da-ae00-acd16f56669f with identifier: 1877881 to the API
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:01:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/6.jpg>
{'auction_title': '',
'c_o_2_emission_value': 86,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '64146edb-736b-56da-ae00-acd16f56669f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 71512,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409899,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363570,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329224,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345802,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64146edb-736b-56da-ae00-acd16f56669f/64146edb-736b-56da-ae00-acd16f56669f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341697,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fh-/35e798854d194103995aede16de59505/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-07-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 Sté 1.5 BlueHDi 100ch S&S Feel Business R - TRANSFO 5 '
'PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': 'C3 Sté 1.5 BlueHDi 100ch S&S Feel Business R - TRANSFO 5 PLACES / 5 '
'SEATS OK + CERTIF OK',
'vin': None,
'year': 2019}
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877881%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [ayvens.fr] INFO: Saving data for 1877881: {'created_time': 1769630519.65411, 'last_price_update_time': 1769630519.654124, 'auction_closing_time': 1769695200.0}
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877881') HTTP/1.1" 204 0
2026-01-28 20:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/8.jpg not downloaded yet
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff56450>
2026-01-28 20:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4377650>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2a650>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg saved to cache
2026-01-28 20:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42dfd50>
2026-01-28 20:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4143110>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [ayvens.fr] INFO: Found listing with ID: 1877884
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877884%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [ayvens.fr] INFO: Scrape type for 1877884: 1
2026-01-28 20:02:01 [ayvens.fr] INFO: Extracting data for car ID: 1877884
2026-01-28 20:02:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 495504ce-3ce5-5a45-912a-fdf31c03781e with identifier: 1877884
2026-01-28 20:02:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 495504ce-3ce5-5a45-912a-fdf31c03781e with scrape type 1
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/1.jpg not downloaded yet
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/2.jpg not downloaded yet
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c404b710>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg saved to cache
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/3.jpg not downloaded yet
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/4.jpg not downloaded yet
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46b41d0>
2026-01-28 20:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e1650>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/4.jpg saved to cache
2026-01-28 20:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40b3150>
2026-01-28 20:02:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fd36cc223ae0a4bb9bca29ec2db3a2055%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item df493e91-9df3-5c24-ab97-ab9f4edca0dc
2026-01-28 20:02:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: df493e91-9df3-5c24-ab97-ab9f4edca0dc, skipping ID generation
2026-01-28 20:02:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df493e91-9df3-5c24-ab97-ab9f4edca0dc with scrape type 1
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item df493e91-9df3-5c24-ab97-ab9f4edca0dc from tracking dictionaries
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item df493e91-9df3-5c24-ab97-ab9f4edca0dc sending to next pipeline
2026-01-28 20:02:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: df493e91-9df3-5c24-ab97-ab9f4edca0dc, identifier: 1877882
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429dcd0>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/3.jpg saved to cache
2026-01-28 20:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4142c50>
2026-01-28 20:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/1.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4087310>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/2.jpg saved to cache
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: df493e91-9df3-5c24-ab97-ab9f4edca0dc with identifier: 1877882
2026-01-28 20:02:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: df493e91-9df3-5c24-ab97-ab9f4edca0dc with identifier: 1877882
2026-01-28 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': '2008 1.2 puretech 100ch s&s allure business', 'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s allure business', 'price': 0, 'odometer': 66882, 'odometer_reading_unit': 'km', 'registration_date': '2021-07-06', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 125, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'df493e91-9df3-5c24-ab97-ab9f4edca0dc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 426627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 426627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 392625}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339388}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 334973}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323158}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 255454}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 370315}], 'current_year_diff': 5, 'age_in_months': 54, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 66882}
Failed validating None in schema:
False
On instance:
{'age_in_months': 54,
'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'gris platinium',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'df493e91-9df3-5c24-ab97-ab9f4edca0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 66882,
'odometer_in_km': 66882,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-06',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s allure business',
'transmission': 'manual',
'trim': '2008 1.2 puretech 100ch s&s allure business',
'vin': None,
'year': 2021}
2026-01-28 20:02:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: df493e91-9df3-5c24-ab97-ab9f4edca0dc spider: ayvens.fr
2026-01-28 20:02:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: df493e91-9df3-5c24-ab97-ab9f4edca0dc due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': '2008 1.2 puretech 100ch s&s allure business', 'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s allure business', 'price': 0, 'odometer': 66882, 'odometer_reading_unit': 'km', 'registration_date': '2021-07-06', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 125, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'df493e91-9df3-5c24-ab97-ab9f4edca0dc', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 426627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 426627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 392625}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339388}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 334973}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323158}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 255454}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 370315}], 'current_year_diff': 5, 'age_in_months': 54, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 66882}
Failed validating None in schema:
False
On instance:
{'age_in_months': 54,
'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'gris platinium',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'df493e91-9df3-5c24-ab97-ab9f4edca0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 66882,
'odometer_in_km': 66882,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-06',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s allure business',
'transmission': 'manual',
'trim': '2008 1.2 puretech 100ch s&s allure business',
'vin': None,
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'df493e91-9df3-5c24-ab97-ab9f4edca0dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 66882,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339388,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 255454,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_df493e91-9df3-5c24-ab97-ab9f4edca0dc/df493e91-9df3-5c24-ab97-ab9f4edca0dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/d36cc223ae0a4bb9bca29ec2db3a2055/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Allure Business',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Allure Business',
'vin': None,
'year': 2021}
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877882%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [ayvens.fr] INFO: Saving data for 1877882: {'created_time': 1769630524.805865, 'last_price_update_time': 1769630524.805876, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877882') HTTP/1.1" 204 0
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/5.jpg not downloaded yet
2026-01-28 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44844d0>
2026-01-28 20:02:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/5.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/6.jpg not downloaded yet
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4321390>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/6.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/7.jpg not downloaded yet
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4322a10>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/8.jpg saved to cache
2026-01-28 20:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43583d0>
2026-01-28 20:02:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F0bb5fcd405744704bd8c480a6ed181ec%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/7.jpg saved to cache
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5ca049ab-8186-51b7-986d-d1fa709e4432
2026-01-28 20:02:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5ca049ab-8186-51b7-986d-d1fa709e4432, skipping ID generation
2026-01-28 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca049ab-8186-51b7-986d-d1fa709e4432 with scrape type 1
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5ca049ab-8186-51b7-986d-d1fa709e4432 from tracking dictionaries
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5ca049ab-8186-51b7-986d-d1fa709e4432 sending to next pipeline
2026-01-28 20:02:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5ca049ab-8186-51b7-986d-d1fa709e4432, identifier: 1877883
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5ca049ab-8186-51b7-986d-d1fa709e4432 with identifier: 1877883
2026-01-28 20:02:06 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5ca049ab-8186-51b7-986d-d1fa709e4432 with identifier: 1877883
2026-01-28 20:02:06 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5ca049ab-8186-51b7-986d-d1fa709e4432 with identifier: 1877883 to the API
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'NOIR METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5ca049ab-8186-51b7-986d-d1fa709e4432',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 52807,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 481001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377687,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 217788,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291290,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 170504,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5ca049ab-8186-51b7-986d-d1fa709e4432/5ca049ab-8186-51b7-986d-d1fa709e4432_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302277,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/0bb5fcd405744704bd8c480a6ed181ec/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-11',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech hybride 145ch Techno',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech hybride 145ch Techno',
'vin': None,
'year': 2023}
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877883%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [ayvens.fr] INFO: Saving data for 1877883: {'created_time': 1769630526.834748, 'last_price_update_time': 1769630526.83476, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877883') HTTP/1.1" 204 0
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/8.jpg not downloaded yet
2026-01-28 20:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:06 [ayvens.fr] INFO: Found listing with ID: 1877885
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877885%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [ayvens.fr] INFO: Scrape type for 1877885: 1
2026-01-28 20:02:06 [ayvens.fr] INFO: Extracting data for car ID: 1877885
2026-01-28 20:02:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 54867851-fd11-5816-8b2d-37e3930fc435 with identifier: 1877885
2026-01-28 20:02:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54867851-fd11-5816-8b2d-37e3930fc435 with scrape type 1
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg not downloaded yet
2026-01-28 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dfb90>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/2.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2bb50>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/1.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg not downloaded yet
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419b890>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/3.jpg saved to cache
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg not downloaded yet
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4323310>
2026-01-28 20:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/4.jpg saved to cache
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg not downloaded yet
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452b710>
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/5.jpg saved to cache
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg not downloaded yet
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e4890>
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/6.jpg saved to cache
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg not downloaded yet
2026-01-28 20:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg not downloaded yet
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfac3fd0>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/7.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg not downloaded yet
2026-01-28 20:02:09 [ayvens.fr] INFO: Found listing with ID: 1877886
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877886%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [ayvens.fr] INFO: Scrape type for 1877886: 1
2026-01-28 20:02:09 [ayvens.fr] INFO: Extracting data for car ID: 1877886
2026-01-28 20:02:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9824bdff-6bb0-57f4-9bda-0df66e907d10 with identifier: 1877886
2026-01-28 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9824bdff-6bb0-57f4-9bda-0df66e907d10 with scrape type 1
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg not downloaded yet
2026-01-28 20:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45baf10>
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F702f3c8017274735a333ae4ce441cb88%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/8.jpg saved to cache
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 495504ce-3ce5-5a45-912a-fdf31c03781e
2026-01-28 20:02:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 495504ce-3ce5-5a45-912a-fdf31c03781e, skipping ID generation
2026-01-28 20:02:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 495504ce-3ce5-5a45-912a-fdf31c03781e with scrape type 1
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 495504ce-3ce5-5a45-912a-fdf31c03781e from tracking dictionaries
2026-01-28 20:02:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 495504ce-3ce5-5a45-912a-fdf31c03781e sending to next pipeline
2026-01-28 20:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 495504ce-3ce5-5a45-912a-fdf31c03781e, identifier: 1877884
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4535510>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg saved to cache
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4337a50>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg saved to cache
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg not downloaded yet
2026-01-28 20:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 495504ce-3ce5-5a45-912a-fdf31c03781e with identifier: 1877884
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 495504ce-3ce5-5a45-912a-fdf31c03781e with identifier: 1877884
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 495504ce-3ce5-5a45-912a-fdf31c03781e spider: ayvens.fr
2026-01-28 20:02:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 495504ce-3ce5-5a45-912a-fdf31c03781e due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '495504ce-3ce5-5a45-912a-fdf31c03781e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 90197,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411408,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282729,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280869,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_495504ce-3ce5-5a45-912a-fdf31c03781e/495504ce-3ce5-5a45-912a-fdf31c03781e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/702f3c8017274735a333ae4ce441cb88/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.5 Blue dCi 85ch Business',
'transmission': 'manual',
'trim': 'Clio 1.5 Blue dCi 85ch Business',
'vin': None,
'year': 2020}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877884%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [ayvens.fr] INFO: Saving data for 1877884: {'created_time': 1769630530.890566, 'last_price_update_time': 1769630530.890581, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877884') HTTP/1.1" 204 0
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg not downloaded yet
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4257b50>
2026-01-28 20:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg not downloaded yet
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg not downloaded yet
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4120850>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg saved to cache
2026-01-28 20:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414d1d0>
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg not downloaded yet
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg not downloaded yet
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4574cd0>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40dbd50>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg not downloaded yet
2026-01-28 20:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b9150>
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F69dc338b56db4f0e89ca7626950f3235%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg saved to cache
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 54867851-fd11-5816-8b2d-37e3930fc435
2026-01-28 20:02:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 54867851-fd11-5816-8b2d-37e3930fc435, skipping ID generation
2026-01-28 20:02:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 54867851-fd11-5816-8b2d-37e3930fc435 with scrape type 1
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 54867851-fd11-5816-8b2d-37e3930fc435 from tracking dictionaries
2026-01-28 20:02:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 54867851-fd11-5816-8b2d-37e3930fc435 sending to next pipeline
2026-01-28 20:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 54867851-fd11-5816-8b2d-37e3930fc435, identifier: 1877885
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4528790>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg saved to cache
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [ayvens.fr] INFO: Found listing with ID: 1877887
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877887%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.fr] INFO: Scrape type for 1877887: 1
2026-01-28 20:02:13 [ayvens.fr] INFO: Extracting data for car ID: 1877887
2026-01-28 20:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 with identifier: 1877887
2026-01-28 20:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 with scrape type 1
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg not downloaded yet
2026-01-28 20:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 54867851-fd11-5816-8b2d-37e3930fc435 with identifier: 1877885
2026-01-28 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 54867851-fd11-5816-8b2d-37e3930fc435 with identifier: 1877885
2026-01-28 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': 'e-2008', 'trim': '2008 e-2008 136ch active pack', 'title': 'peugeot e-2008 2008 e-2008 136ch active pack', 'price': 0, 'odometer': 64938, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-12', 'year': 2022, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '54867851-fd11-5816-8b2d-37e3930fc435', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 384133}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 384133}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 426153}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 386239}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 367870}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335436}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 320288}], 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'peugeot e-2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 64938} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '54867851-fd11-5816-8b2d-37e3930fc435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot e-2008',
'model': 'e-2008',
'odometer': 64938,
'odometer_in_km': 64938,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot e-2008 2008 e-2008 136ch active pack',
'transmission': 'automatic',
'trim': '2008 e-2008 136ch active pack',
'vin': None,
'year': 2022}
2026-01-28 20:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 54867851-fd11-5816-8b2d-37e3930fc435 spider: ayvens.fr
2026-01-28 20:02:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 54867851-fd11-5816-8b2d-37e3930fc435 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': 'e-2008', 'trim': '2008 e-2008 136ch active pack', 'title': 'peugeot e-2008 2008 e-2008 136ch active pack', 'price': 0, 'odometer': 64938, 'odometer_reading_unit': 'km', 'registration_date': '2022-10-12', 'year': 2022, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '54867851-fd11-5816-8b2d-37e3930fc435', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 384133}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 384133}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 426153}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 386239}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 367870}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335436}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 320288}], 'current_year_diff': 4, 'age_in_months': 39, 'make_model': 'peugeot e-2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 64938} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 39,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '54867851-fd11-5816-8b2d-37e3930fc435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot e-2008',
'model': 'e-2008',
'odometer': 64938,
'odometer_in_km': 64938,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot e-2008 2008 e-2008 136ch active pack',
'transmission': 'automatic',
'trim': '2008 e-2008 136ch active pack',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': '54867851-fd11-5816-8b2d-37e3930fc435',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-2008',
'odometer': 64938,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386239,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335436,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_54867851-fd11-5816-8b2d-37e3930fc435/54867851-fd11-5816-8b2d-37e3930fc435_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/69dc338b56db4f0e89ca7626950f3235/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-12',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-2008 2008 e-2008 136ch Active Pack',
'transmission': 'automatic',
'trim': '2008 e-2008 136ch Active Pack',
'vin': None,
'year': 2022}
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877885%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [ayvens.fr] INFO: Saving data for 1877885: {'created_time': 1769630533.749118, 'last_price_update_time': 1769630533.749133, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877885') HTTP/1.1" 204 0
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg not downloaded yet
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff34750>
2026-01-28 20:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441b410>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg not downloaded yet
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e6390>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg saved to cache
2026-01-28 20:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ecc50>
2026-01-28 20:02:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg not downloaded yet
2026-01-28 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg not downloaded yet
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4336f90>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg not downloaded yet
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg not downloaded yet
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4198090>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg saved to cache
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg not downloaded yet
2026-01-28 20:02:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4155910>
2026-01-28 20:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F3065deaa1fa74a569afdce1b1f9695ee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg saved to cache
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9824bdff-6bb0-57f4-9bda-0df66e907d10
2026-01-28 20:02:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9824bdff-6bb0-57f4-9bda-0df66e907d10, skipping ID generation
2026-01-28 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9824bdff-6bb0-57f4-9bda-0df66e907d10 with scrape type 1
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9824bdff-6bb0-57f4-9bda-0df66e907d10 from tracking dictionaries
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9824bdff-6bb0-57f4-9bda-0df66e907d10 sending to next pipeline
2026-01-28 20:02:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9824bdff-6bb0-57f4-9bda-0df66e907d10, identifier: 1877886
2026-01-28 20:02:16 [ayvens.fr] INFO: Found listing with ID: 1877888
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877888%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [ayvens.fr] INFO: Scrape type for 1877888: 1
2026-01-28 20:02:16 [ayvens.fr] INFO: Extracting data for car ID: 1877888
2026-01-28 20:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 with identifier: 1877888
2026-01-28 20:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 with scrape type 1
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/1.jpg not downloaded yet
2026-01-28 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9824bdff-6bb0-57f4-9bda-0df66e907d10 with identifier: 1877886
2026-01-28 20:02:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9824bdff-6bb0-57f4-9bda-0df66e907d10 with identifier: 1877886
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris kristall', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'crossland', 'trim': 'crossland 1.2 turbo 110ch elegance', 'title': 'opel crossland crossland 1.2 turbo 110ch elegance', 'price': 0, 'odometer': 37275, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-20', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 131, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '9824bdff-6bb0-57f4-9bda-0df66e907d10', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 370373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 370373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 308731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 260773}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 305409}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242658}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 206983}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 422033}], 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'opel crossland', 'sanitized_make': 'opel', 'odometer_in_km': 37275}
Failed validating None in schema:
False
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'gris kristall',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '9824bdff-6bb0-57f4-9bda-0df66e907d10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'opel',
'make_model': 'opel crossland',
'model': 'crossland',
'odometer': 37275,
'odometer_in_km': 37275,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland crossland 1.2 turbo 110ch elegance',
'transmission': 'manual',
'trim': 'crossland 1.2 turbo 110ch elegance',
'vin': None,
'year': 2023}
2026-01-28 20:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 9824bdff-6bb0-57f4-9bda-0df66e907d10 spider: ayvens.fr
2026-01-28 20:02:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 9824bdff-6bb0-57f4-9bda-0df66e907d10 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris kristall', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'crossland', 'trim': 'crossland 1.2 turbo 110ch elegance', 'title': 'opel crossland crossland 1.2 turbo 110ch elegance', 'price': 0, 'odometer': 37275, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-20', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 131, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '9824bdff-6bb0-57f4-9bda-0df66e907d10', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 370373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 370373}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 308731}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 260773}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 305409}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242658}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 206983}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 422033}], 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'opel crossland', 'sanitized_make': 'opel', 'odometer_in_km': 37275}
Failed validating None in schema:
False
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'gris kristall',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '9824bdff-6bb0-57f4-9bda-0df66e907d10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'opel',
'make_model': 'opel crossland',
'model': 'crossland',
'odometer': 37275,
'odometer_in_km': 37275,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland crossland 1.2 turbo 110ch elegance',
'transmission': 'manual',
'trim': 'crossland 1.2 turbo 110ch elegance',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '9824bdff-6bb0-57f4-9bda-0df66e907d10',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 37275,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9824bdff-6bb0-57f4-9bda-0df66e907d10/9824bdff-6bb0-57f4-9bda-0df66e907d10_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422033,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/3065deaa1fa74a569afdce1b1f9695ee/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance',
'vin': None,
'year': 2023}
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877886%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [ayvens.fr] INFO: Saving data for 1877886: {'created_time': 1769630536.764935, 'last_price_update_time': 1769630536.764946, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877886') HTTP/1.1" 204 0
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/2.jpg not downloaded yet
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4156050>
2026-01-28 20:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/3.jpg not downloaded yet
2026-01-28 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/4.jpg not downloaded yet
2026-01-28 20:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a7e50>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4470590>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg saved to cache
2026-01-28 20:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4085290>
2026-01-28 20:02:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c7590>
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg saved to cache
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/5.jpg not downloaded yet
2026-01-28 20:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/6.jpg not downloaded yet
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4574750>
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c455d390>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/7.jpg not downloaded yet
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407da50>
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Fdd66f35c139442e88f693843d346fc3b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg saved to cache
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3
2026-01-28 20:02:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3, skipping ID generation
2026-01-28 20:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 with scrape type 1
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 from tracking dictionaries
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 sending to next pipeline
2026-01-28 20:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3, identifier: 1877887
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/8.jpg not downloaded yet
2026-01-28 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 with identifier: 1877887
2026-01-28 20:02:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 with identifier: 1877887
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': '308 1.2 puretech 130ch s&s active pack eat8', 'title': 'peugeot 308 308 1.2 puretech 130ch s&s active pack eat8', 'price': 0, 'odometer': 107441, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-15', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 127, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 525871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 525871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 536880}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 342061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 344991}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 352807}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 187074}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 360513}], 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 107441}
Failed validating None in schema:
False
On instance:
{'age_in_months': 43,
'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 107441,
'odometer_in_km': 107441,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-15',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 308 1.2 puretech 130ch s&s active pack eat8',
'transmission': 'automatic',
'trim': '308 1.2 puretech 130ch s&s active pack eat8',
'vin': None,
'year': 2022}
2026-01-28 20:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 spider: ayvens.fr
2026-01-28 20:02:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '308', 'trim': '308 1.2 puretech 130ch s&s active pack eat8', 'title': 'peugeot 308 308 1.2 puretech 130ch s&s active pack eat8', 'price': 0, 'odometer': 107441, 'odometer_reading_unit': 'km', 'registration_date': '2022-06-15', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 127, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 525871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 525871}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 536880}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 342061}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 344991}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 352807}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 187074}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 360513}], 'current_year_diff': 4, 'age_in_months': 43, 'make_model': 'peugeot 308', 'sanitized_make': 'peugeot', 'odometer_in_km': 107441}
Failed validating None in schema:
False
On instance:
{'age_in_months': 43,
'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 308',
'model': '308',
'odometer': 107441,
'odometer_in_km': 107441,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-15',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 308 308 1.2 puretech 130ch s&s active pack eat8',
'transmission': 'automatic',
'trim': '308 1.2 puretech 130ch s&s active pack eat8',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 107441,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 525871,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 536880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344991,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 187074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3/ca42364b-ded8-51a4-a0a0-5bb9b9bcb3c3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/dd66f35c139442e88f693843d346fc3b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '308 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877887%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [ayvens.fr] INFO: Saving data for 1877887: {'created_time': 1769630540.136564, 'last_price_update_time': 1769630540.136577, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877887') HTTP/1.1" 204 0
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [ayvens.fr] INFO: Found listing with ID: 1877889
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877889%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [ayvens.fr] INFO: Scrape type for 1877889: 1
2026-01-28 20:02:20 [ayvens.fr] INFO: Extracting data for car ID: 1877889
2026-01-28 20:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a302923a-6155-535c-9d2c-8c500f8ad600 with identifier: 1877889
2026-01-28 20:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a302923a-6155-535c-9d2c-8c500f8ad600 with scrape type 1
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/1.jpg not downloaded yet
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/2.jpg not downloaded yet
2026-01-28 20:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/3.jpg not downloaded yet
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/4.jpg not downloaded yet
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/5.jpg not downloaded yet
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/6.jpg not downloaded yet
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41d95d0>
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/2.jpg saved to cache
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40db6d0>
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/1.jpg saved to cache
2026-01-28 20:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4314850>
2026-01-28 20:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/4.jpg saved to cache
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/7.jpg not downloaded yet
2026-01-28 20:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/8.jpg not downloaded yet
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4536fd0>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/3.jpg saved to cache
2026-01-28 20:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4048f50>
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/5.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:22 [ayvens.fr] INFO: Found listing with ID: 1877890
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877890%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [ayvens.fr] INFO: Scrape type for 1877890: 1
2026-01-28 20:02:22 [ayvens.fr] INFO: Extracting data for car ID: 1877890
2026-01-28 20:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c914927d-b899-56a1-99a8-602234d8afb5 with identifier: 1877890
2026-01-28 20:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c914927d-b899-56a1-99a8-602234d8afb5 with scrape type 1
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/1.jpg not downloaded yet
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/2.jpg not downloaded yet
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414d450>
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/7.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d2dd0>
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/6.jpg saved to cache
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/3.jpg not downloaded yet
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/4.jpg not downloaded yet
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435af50>
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Ffcb88d8f43ea42588f8d93efb18c27ef%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/8.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275
2026-01-28 20:02:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fdea7bb5-a93f-51b5-8241-0ff0bdbd7275, skipping ID generation
2026-01-28 20:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 with scrape type 1
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 from tracking dictionaries
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 sending to next pipeline
2026-01-28 20:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: fdea7bb5-a93f-51b5-8241-0ff0bdbd7275, identifier: 1877888
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4486190>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/1.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4199010>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/3.jpg saved to cache
2026-01-28 20:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dc050>
2026-01-28 20:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/2.jpg saved to cache
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/5.jpg not downloaded yet
2026-01-28 20:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 with identifier: 1877888
2026-01-28 20:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 with identifier: 1877888
2026-01-28 20:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: fdea7bb5-a93f-51b5-8241-0ff0bdbd7275 with identifier: 1877888 to the API
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'fdea7bb5-a93f-51b5-8241-0ff0bdbd7275',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 106573,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361009,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193873,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fdea7bb5-a93f-51b5-8241-0ff0bdbd7275/fdea7bb5-a93f-51b5-8241-0ff0bdbd7275_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289391,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/fcb88d8f43ea42588f8d93efb18c27ef/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '2008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877888%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [ayvens.fr] INFO: Saving data for 1877888: {'created_time': 1769630544.606394, 'last_price_update_time': 1769630544.606412, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877888') HTTP/1.1" 204 0
2026-01-28 20:02:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/6.jpg not downloaded yet
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b8f50>
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/4.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435fed0>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/5.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4535c10>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/6.jpg saved to cache
2026-01-28 20:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4315a10>
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/7.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/7.jpg not downloaded yet
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/8.jpg not downloaded yet
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b9350>
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffg-%252F438e2c8383c94c359e19230e2d35b666%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/8.jpg saved to cache
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a302923a-6155-535c-9d2c-8c500f8ad600
2026-01-28 20:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a302923a-6155-535c-9d2c-8c500f8ad600, skipping ID generation
2026-01-28 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a302923a-6155-535c-9d2c-8c500f8ad600 with scrape type 1
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a302923a-6155-535c-9d2c-8c500f8ad600 from tracking dictionaries
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a302923a-6155-535c-9d2c-8c500f8ad600 sending to next pipeline
2026-01-28 20:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a302923a-6155-535c-9d2c-8c500f8ad600, identifier: 1877889
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a302923a-6155-535c-9d2c-8c500f8ad600 with identifier: 1877889
2026-01-28 20:02:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a302923a-6155-535c-9d2c-8c500f8ad600 with identifier: 1877889
2026-01-28 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a302923a-6155-535c-9d2c-8c500f8ad600 spider: ayvens.fr
2026-01-28 20:02:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: a302923a-6155-535c-9d2c-8c500f8ad600 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'BLEU KYANOS',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'a302923a-6155-535c-9d2c-8c500f8ad600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 110273,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421609,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483074,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437252,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329528,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395870,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a302923a-6155-535c-9d2c-8c500f8ad600/a302923a-6155-535c-9d2c-8c500f8ad600_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377273,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fg-/438e2c8383c94c359e19230e2d35b666/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-05-21',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 650kg BlueHDi 100 S&S Driver',
'transmission': 'manual',
'trim': 'Berlingo Van M 650kg BlueHDi 100 S&S Driver',
'vin': None,
'year': 2019}
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877889%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [ayvens.fr] INFO: Saving data for 1877889: {'created_time': 1769630546.7732, 'last_price_update_time': 1769630546.773212, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877889') HTTP/1.1" 204 0
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [ayvens.fr] INFO: Found listing with ID: 1877891
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877891%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [ayvens.fr] INFO: Scrape type for 1877891: 1
2026-01-28 20:02:26 [ayvens.fr] INFO: Extracting data for car ID: 1877891
2026-01-28 20:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4ee3c15-c4f6-5812-a326-5d63662c5973 with identifier: 1877891
2026-01-28 20:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ee3c15-c4f6-5812-a326-5d63662c5973 with scrape type 1
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg not downloaded yet
2026-01-28 20:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg not downloaded yet
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1eea90>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/1.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c455ef50>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/2.jpg saved to cache
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg not downloaded yet
2026-01-28 20:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44570d0>
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/3.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4120e50>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/4.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:28 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 0 pages/min), scraped 10 items (at 6 items/min)
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg not downloaded yet
2026-01-28 20:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg not downloaded yet
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e5110>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/6.jpg saved to cache
2026-01-28 20:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4316110>
2026-01-28 20:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/5.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458b0d0>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/7.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg not downloaded yet
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40c9190>
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F7a5a7c7e91cd4654a99439de8c82af42%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/8.jpg saved to cache
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c914927d-b899-56a1-99a8-602234d8afb5
2026-01-28 20:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c914927d-b899-56a1-99a8-602234d8afb5, skipping ID generation
2026-01-28 20:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c914927d-b899-56a1-99a8-602234d8afb5 with scrape type 1
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c914927d-b899-56a1-99a8-602234d8afb5 from tracking dictionaries
2026-01-28 20:02:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c914927d-b899-56a1-99a8-602234d8afb5 sending to next pipeline
2026-01-28 20:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c914927d-b899-56a1-99a8-602234d8afb5, identifier: 1877890
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg not downloaded yet
2026-01-28 20:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c914927d-b899-56a1-99a8-602234d8afb5 with identifier: 1877890
2026-01-28 20:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c914927d-b899-56a1-99a8-602234d8afb5 with identifier: 1877890
2026-01-28 20:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: c914927d-b899-56a1-99a8-602234d8afb5 with identifier: 1877890 to the API
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'c914927d-b899-56a1-99a8-602234d8afb5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 101211,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311921,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290515,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292437,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 224724,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c914927d-b899-56a1-99a8-602234d8afb5/c914927d-b899-56a1-99a8-602234d8afb5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252799,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/7a5a7c7e91cd4654a99439de8c82af42/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-18',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid 225ch Business e-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid 225ch Business e-EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877890%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [ayvens.fr] INFO: Saving data for 1877890: {'created_time': 1769630550.410023, 'last_price_update_time': 1769630550.410035, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877890') HTTP/1.1" 204 0
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg not downloaded yet
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [ayvens.fr] INFO: Found listing with ID: 1877892
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877892%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [ayvens.fr] INFO: Scrape type for 1877892: 1
2026-01-28 20:02:30 [ayvens.fr] INFO: Extracting data for car ID: 1877892
2026-01-28 20:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9bca482-16ba-5cf3-899e-899a14ac21d0 with identifier: 1877892
2026-01-28 20:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9bca482-16ba-5cf3-899e-899a14ac21d0 with scrape type 1
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg not downloaded yet
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg not downloaded yet
2026-01-28 20:02:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg not downloaded yet
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4486f90>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg saved to cache
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg not downloaded yet
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41d9d50>
2026-01-28 20:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435ba90>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg not downloaded yet
2026-01-28 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2a450>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg saved to cache
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg not downloaded yet
2026-01-28 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg not downloaded yet
2026-01-28 20:02:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43148d0>
2026-01-28 20:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg not downloaded yet
2026-01-28 20:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:32 [ayvens.fr] INFO: Found listing with ID: 1877893
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877893%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [ayvens.fr] INFO: Scrape type for 1877893: 1
2026-01-28 20:02:32 [ayvens.fr] INFO: Extracting data for car ID: 1877893
2026-01-28 20:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65039767-4b4c-5b54-a900-bfbc7bac19b0 with identifier: 1877893
2026-01-28 20:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65039767-4b4c-5b54-a900-bfbc7bac19b0 with scrape type 1
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/1.jpg not downloaded yet
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4323dd0>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d2110>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg saved to cache
2026-01-28 20:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4058390>
2026-01-28 20:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg saved to cache
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454ce90>
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffr-%252F9fc6d83f79444b778351d89d3735d0b0%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg saved to cache
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b4ee3c15-c4f6-5812-a326-5d63662c5973
2026-01-28 20:02:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b4ee3c15-c4f6-5812-a326-5d63662c5973, skipping ID generation
2026-01-28 20:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4ee3c15-c4f6-5812-a326-5d63662c5973 with scrape type 1
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b4ee3c15-c4f6-5812-a326-5d63662c5973 from tracking dictionaries
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b4ee3c15-c4f6-5812-a326-5d63662c5973 sending to next pipeline
2026-01-28 20:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b4ee3c15-c4f6-5812-a326-5d63662c5973, identifier: 1877891
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/2.jpg not downloaded yet
2026-01-28 20:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b4ee3c15-c4f6-5812-a326-5d63662c5973 with identifier: 1877891
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b4ee3c15-c4f6-5812-a326-5d63662c5973 with identifier: 1877891
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'berlingo', 'trim': 'berlingo van m 1000kg puretech 130 s&s worker eat8', 'title': 'citroën berlingo berlingo van m 1000kg puretech 130 s&s worker eat8', 'price': 0, 'odometer': 84588, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-07', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 3, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 126, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b4ee3c15-c4f6-5812-a326-5d63662c5973', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 395319}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 395319}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 441497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 464859}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 368963}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 353003}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 351138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 433516}], 'current_year_diff': 6, 'age_in_months': 65, 'make_model': 'citroën berlingo', 'sanitized_make': 'citron', 'odometer_in_km': 84588}
Failed validating None in schema:
False
On instance:
{'age_in_months': 65,
'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 4,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'b4ee3c15-c4f6-5812-a326-5d63662c5973',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën berlingo',
'model': 'berlingo',
'odometer': 84588,
'odometer_in_km': 84588,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464859,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-07',
'sanitized_make': 'citron',
'seats_number': 3,
'seller_name': None,
'title': 'citroën berlingo berlingo van m 1000kg puretech 130 s&s '
'worker eat8',
'transmission': 'automatic',
'trim': 'berlingo van m 1000kg puretech 130 s&s worker eat8',
'vin': None,
'year': 2020}
2026-01-28 20:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b4ee3c15-c4f6-5812-a326-5d63662c5973 spider: ayvens.fr
2026-01-28 20:02:33 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: b4ee3c15-c4f6-5812-a326-5d63662c5973 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'berlingo', 'trim': 'berlingo van m 1000kg puretech 130 s&s worker eat8', 'title': 'citroën berlingo berlingo van m 1000kg puretech 130 s&s worker eat8', 'price': 0, 'odometer': 84588, 'odometer_reading_unit': 'km', 'registration_date': '2020-08-07', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 4, 'seats_number': 3, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 126, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b4ee3c15-c4f6-5812-a326-5d63662c5973', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 395319}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 395319}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 441497}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 464859}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 368963}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 353003}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 351138}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 433516}], 'current_year_diff': 6, 'age_in_months': 65, 'make_model': 'citroën berlingo', 'sanitized_make': 'citron', 'odometer_in_km': 84588}
Failed validating None in schema:
False
On instance:
{'age_in_months': 65,
'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 4,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'b4ee3c15-c4f6-5812-a326-5d63662c5973',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën berlingo',
'model': 'berlingo',
'odometer': 84588,
'odometer_in_km': 84588,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464859,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-07',
'sanitized_make': 'citron',
'seats_number': 3,
'seller_name': None,
'title': 'citroën berlingo berlingo van m 1000kg puretech 130 s&s '
'worker eat8',
'transmission': 'automatic',
'trim': 'berlingo van m 1000kg puretech 130 s&s worker eat8',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'b4ee3c15-c4f6-5812-a326-5d63662c5973',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 84588,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 464859,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368963,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351138,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b4ee3c15-c4f6-5812-a326-5d63662c5973/b4ee3c15-c4f6-5812-a326-5d63662c5973_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433516,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fr-/9fc6d83f79444b778351d89d3735d0b0/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-08-07',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 1000kg PureTech 130 S&S Worker EAT8',
'transmission': 'automatic',
'trim': 'Berlingo Van M 1000kg PureTech 130 S&S Worker EAT8',
'vin': None,
'year': 2020}
2026-01-28 20:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877891%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [ayvens.fr] INFO: Saving data for 1877891: {'created_time': 1769630554.004542, 'last_price_update_time': 1769630554.004551, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877891') HTTP/1.1" 204 0
2026-01-28 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/3.jpg not downloaded yet
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a6990>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4359f10>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg saved to cache
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/4.jpg not downloaded yet
2026-01-28 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/5.jpg not downloaded yet
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c451a3d0>
2026-01-28 20:02:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c61d0>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/6.jpg not downloaded yet
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/7.jpg not downloaded yet
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e61d0>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg saved to cache
2026-01-28 20:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f8d90>
2026-01-28 20:02:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/8.jpg not downloaded yet
2026-01-28 20:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:36 [ayvens.fr] INFO: Found listing with ID: 1877894
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877894%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [ayvens.fr] INFO: Scrape type for 1877894: 1
2026-01-28 20:02:36 [ayvens.fr] INFO: Extracting data for car ID: 1877894
2026-01-28 20:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07cea4b4-925c-527c-b7db-e1e0d4e45252 with identifier: 1877894
2026-01-28 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07cea4b4-925c-527c-b7db-e1e0d4e45252 with scrape type 1
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg not downloaded yet
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4297350>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fcb7e8df33ca94814be2f4511179d37ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9bca482-16ba-5cf3-899e-899a14ac21d0
2026-01-28 20:02:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9bca482-16ba-5cf3-899e-899a14ac21d0, skipping ID generation
2026-01-28 20:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9bca482-16ba-5cf3-899e-899a14ac21d0 with scrape type 1
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c9bca482-16ba-5cf3-899e-899a14ac21d0 from tracking dictionaries
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9bca482-16ba-5cf3-899e-899a14ac21d0 sending to next pipeline
2026-01-28 20:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c9bca482-16ba-5cf3-899e-899a14ac21d0, identifier: 1877892
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4334cd0>
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/1.jpg saved to cache
2026-01-28 20:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg not downloaded yet
2026-01-28 20:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c9bca482-16ba-5cf3-899e-899a14ac21d0 with identifier: 1877892
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c9bca482-16ba-5cf3-899e-899a14ac21d0 with identifier: 1877892
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': '2008 1.2 puretech 130ch s&s allure pack eat8', 'title': 'peugeot 2008 2008 1.2 puretech 130ch s&s allure pack eat8', 'price': 0, 'odometer': 61565, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-10', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 133, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'c9bca482-16ba-5cf3-899e-899a14ac21d0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375374}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375374}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 372876}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 319002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 387485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375228}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 492625}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 61565}
Failed validating None in schema:
False
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'c9bca482-16ba-5cf3-899e-899a14ac21d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 61565,
'odometer_in_km': 61565,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-10',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 2008 1.2 puretech 130ch s&s allure pack eat8',
'transmission': 'automatic',
'trim': '2008 1.2 puretech 130ch s&s allure pack eat8',
'vin': None,
'year': 2023}
2026-01-28 20:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: c9bca482-16ba-5cf3-899e-899a14ac21d0 spider: ayvens.fr
2026-01-28 20:02:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: c9bca482-16ba-5cf3-899e-899a14ac21d0 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': '2008 1.2 puretech 130ch s&s allure pack eat8', 'title': 'peugeot 2008 2008 1.2 puretech 130ch s&s allure pack eat8', 'price': 0, 'odometer': 61565, 'odometer_reading_unit': 'km', 'registration_date': '2023-01-10', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 133, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'c9bca482-16ba-5cf3-899e-899a14ac21d0', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375374}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375374}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 372876}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 319002}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 387485}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312751}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 375228}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 492625}], 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 61565}
Failed validating None in schema:
False
On instance:
{'age_in_months': 36,
'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'c9bca482-16ba-5cf3-899e-899a14ac21d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 61565,
'odometer_in_km': 61565,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-10',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 2008 1.2 puretech 130ch s&s allure pack eat8',
'transmission': 'automatic',
'trim': '2008 1.2 puretech 130ch s&s allure pack eat8',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'c9bca482-16ba-5cf3-899e-899a14ac21d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 61565,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375374,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312751,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9bca482-16ba-5cf3-899e-899a14ac21d0/c9bca482-16ba-5cf3-899e-899a14ac21d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492625,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/cb7e8df33ca94814be2f4511179d37ca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-10',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '2008 1.2 PureTech 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2023}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877892%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [ayvens.fr] INFO: Saving data for 1877892: {'created_time': 1769630557.365241, 'last_price_update_time': 1769630557.365251, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877892') HTTP/1.1" 204 0
2026-01-28 20:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg not downloaded yet
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ed7d0>
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/2.jpg saved to cache
2026-01-28 20:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b2c50>
2026-01-28 20:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/3.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c470c250>
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/4.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg not downloaded yet
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4507210>
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/5.jpg saved to cache
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg not downloaded yet
2026-01-28 20:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg not downloaded yet
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f8ed0>
2026-01-28 20:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/7.jpg saved to cache
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaeef90>
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/6.jpg saved to cache
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg not downloaded yet
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf144090>
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Ffd0361c8a32e427a9f604372062aaedc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/8.jpg saved to cache
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65039767-4b4c-5b54-a900-bfbc7bac19b0
2026-01-28 20:02:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65039767-4b4c-5b54-a900-bfbc7bac19b0, skipping ID generation
2026-01-28 20:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65039767-4b4c-5b54-a900-bfbc7bac19b0 with scrape type 1
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 65039767-4b4c-5b54-a900-bfbc7bac19b0 from tracking dictionaries
2026-01-28 20:02:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65039767-4b4c-5b54-a900-bfbc7bac19b0 sending to next pipeline
2026-01-28 20:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 65039767-4b4c-5b54-a900-bfbc7bac19b0, identifier: 1877893
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg not downloaded yet
2026-01-28 20:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 65039767-4b4c-5b54-a900-bfbc7bac19b0 with identifier: 1877893
2026-01-28 20:02:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 65039767-4b4c-5b54-a900-bfbc7bac19b0 with identifier: 1877893
2026-01-28 20:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 65039767-4b4c-5b54-a900-bfbc7bac19b0 with identifier: 1877893 to the API
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '65039767-4b4c-5b54-a900-bfbc7bac19b0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 57092,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 241712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355379,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273258,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65039767-4b4c-5b54-a900-bfbc7bac19b0/65039767-4b4c-5b54-a900-bfbc7bac19b0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/fd0361c8a32e427a9f604372062aaedc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-18',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Clio Réversible 1.0 TCe 90ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877893%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [ayvens.fr] INFO: Saving data for 1877893: {'created_time': 1769630560.519241, 'last_price_update_time': 1769630560.519253, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877893') HTTP/1.1" 204 0
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:40 [ayvens.fr] INFO: Found listing with ID: 1877895
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877895%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [ayvens.fr] INFO: Scrape type for 1877895: 1
2026-01-28 20:02:40 [ayvens.fr] INFO: Extracting data for car ID: 1877895
2026-01-28 20:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b6de0a7-62e2-5560-bf70-8c6ed487e23e with identifier: 1877895
2026-01-28 20:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e with scrape type 1
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/1.jpg not downloaded yet
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435fcd0>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg saved to cache
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/2.jpg not downloaded yet
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/3.jpg not downloaded yet
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41d91d0>
2026-01-28 20:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/4.jpg not downloaded yet
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/5.jpg not downloaded yet
2026-01-28 20:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4314050>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414f8d0>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg saved to cache
2026-01-28 20:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4383290>
2026-01-28 20:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg saved to cache
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/6.jpg not downloaded yet
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/7.jpg not downloaded yet
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf147210>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg saved to cache
2026-01-28 20:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4519e90>
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/8.jpg not downloaded yet
2026-01-28 20:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:43 [ayvens.fr] INFO: Found listing with ID: 1877896
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877896%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [ayvens.fr] INFO: Scrape type for 1877896: 1
2026-01-28 20:02:43 [ayvens.fr] INFO: Extracting data for car ID: 1877896
2026-01-28 20:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 with identifier: 1877896
2026-01-28 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 with scrape type 1
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg not downloaded yet
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaee650>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/1.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4048e90>
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffk-%252Fb7ebeec6cded4afb81c6cf6fd753ea4d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg saved to cache
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07cea4b4-925c-527c-b7db-e1e0d4e45252
2026-01-28 20:02:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07cea4b4-925c-527c-b7db-e1e0d4e45252, skipping ID generation
2026-01-28 20:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07cea4b4-925c-527c-b7db-e1e0d4e45252 with scrape type 1
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07cea4b4-925c-527c-b7db-e1e0d4e45252 from tracking dictionaries
2026-01-28 20:02:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07cea4b4-925c-527c-b7db-e1e0d4e45252 sending to next pipeline
2026-01-28 20:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 07cea4b4-925c-527c-b7db-e1e0d4e45252, identifier: 1877894
2026-01-28 20:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 07cea4b4-925c-527c-b7db-e1e0d4e45252 with identifier: 1877894
2026-01-28 20:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 07cea4b4-925c-527c-b7db-e1e0d4e45252 with identifier: 1877894
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208 business r', 'trim': '208 business r 1.2 puretech 82ch s&s active euro6c', 'title': 'peugeot 208 business r 208 business r 1.2 puretech 82ch s&s active euro6c', 'price': 0, 'odometer': 60759, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-20', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 111, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '07cea4b4-925c-527c-b7db-e1e0d4e45252', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 437214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 437214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 453761}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 487231}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 384159}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409574}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 358825}], 'current_year_diff': 7, 'age_in_months': 76, 'make_model': 'peugeot 208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 60759}
Failed validating None in schema:
False
On instance:
{'age_in_months': 76,
'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'blanc',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '07cea4b4-925c-527c-b7db-e1e0d4e45252',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208 business r',
'model': '208 business r',
'odometer': 60759,
'odometer_in_km': 60759,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-20',
'sanitized_make': 'peugeot',
'seats_number': 2,
'seller_name': None,
'title': 'peugeot 208 business r 208 business r 1.2 puretech 82ch s&s '
'active euro6c',
'transmission': 'manual',
'trim': '208 business r 1.2 puretech 82ch s&s active euro6c',
'vin': None,
'year': 2019}
2026-01-28 20:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 07cea4b4-925c-527c-b7db-e1e0d4e45252 spider: ayvens.fr
2026-01-28 20:02:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 07cea4b4-925c-527c-b7db-e1e0d4e45252 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208 business r', 'trim': '208 business r 1.2 puretech 82ch s&s active euro6c', 'title': 'peugeot 208 business r 208 business r 1.2 puretech 82ch s&s active euro6c', 'price': 0, 'odometer': 60759, 'odometer_reading_unit': 'km', 'registration_date': '2019-09-20', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 111, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '07cea4b4-925c-527c-b7db-e1e0d4e45252', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 437214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 437214}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 453761}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 487231}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335783}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 384159}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409574}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 358825}], 'current_year_diff': 7, 'age_in_months': 76, 'make_model': 'peugeot 208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 60759}
Failed validating None in schema:
False
On instance:
{'age_in_months': 76,
'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'blanc',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '07cea4b4-925c-527c-b7db-e1e0d4e45252',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208 business r',
'model': '208 business r',
'odometer': 60759,
'odometer_in_km': 60759,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-20',
'sanitized_make': 'peugeot',
'seats_number': 2,
'seller_name': None,
'title': 'peugeot 208 business r 208 business r 1.2 puretech 82ch s&s '
'active euro6c',
'transmission': 'manual',
'trim': '208 business r 1.2 puretech 82ch s&s active euro6c',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '07cea4b4-925c-527c-b7db-e1e0d4e45252',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208 BUSINESS R',
'odometer': 60759,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437214,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 487231,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335783,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384159,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07cea4b4-925c-527c-b7db-e1e0d4e45252/07cea4b4-925c-527c-b7db-e1e0d4e45252_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 358825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fk-/b7ebeec6cded4afb81c6cf6fd753ea4d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-09-20',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 208 BUSINESS R 208 Business R 1.2 PureTech 82ch S&S Active '
'Euro6c',
'transmission': 'manual',
'trim': '208 Business R 1.2 PureTech 82ch S&S Active Euro6c',
'vin': None,
'year': 2019}
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877894%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [ayvens.fr] INFO: Saving data for 1877894: {'created_time': 1769630564.205318, 'last_price_update_time': 1769630564.205332, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877894') HTTP/1.1" 204 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg not downloaded yet
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45893d0>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/2.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a4910>
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/3.jpg saved to cache
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg not downloaded yet
2026-01-28 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg not downloaded yet
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg not downloaded yet
2026-01-28 20:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg not downloaded yet
2026-01-28 20:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg not downloaded yet
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff35a90>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/5.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45072d0>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/4.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg not downloaded yet
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4519450>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/7.jpg saved to cache
2026-01-28 20:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4589e90>
2026-01-28 20:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/6.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:46 [ayvens.fr] INFO: Found listing with ID: 1877897
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877897%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [ayvens.fr] INFO: Scrape type for 1877897: 1
2026-01-28 20:02:46 [ayvens.fr] INFO: Extracting data for car ID: 1877897
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf6476dd-7660-5bb7-9e63-d4958e73699e with identifier: 1877897
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6476dd-7660-5bb7-9e63-d4958e73699e with scrape type 1
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/1.jpg not downloaded yet
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2b450>
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fea78713f29ea4627b039e1a6e96e8fbb%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/8.jpg saved to cache
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e
2026-01-28 20:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b6de0a7-62e2-5560-bf70-8c6ed487e23e, skipping ID generation
2026-01-28 20:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e with scrape type 1
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e from tracking dictionaries
2026-01-28 20:02:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b6de0a7-62e2-5560-bf70-8c6ed487e23e sending to next pipeline
2026-01-28 20:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6b6de0a7-62e2-5560-bf70-8c6ed487e23e, identifier: 1877895
2026-01-28 20:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6b6de0a7-62e2-5560-bf70-8c6ed487e23e with identifier: 1877895
2026-01-28 20:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6b6de0a7-62e2-5560-bf70-8c6ed487e23e with identifier: 1877895
2026-01-28 20:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6b6de0a7-62e2-5560-bf70-8c6ed487e23e with identifier: 1877895 to the API
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'NOIR ETOILE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '6b6de0a7-62e2-5560-bf70-8c6ed487e23e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 53349,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303981,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343900,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340973,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292402,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302611,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b6de0a7-62e2-5560-bf70-8c6ed487e23e/6b6de0a7-62e2-5560-bf70-8c6ed487e23e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417233,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ea78713f29ea4627b039e1a6e96e8fbb/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-22',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio Réversible 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2021}
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877895%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [ayvens.fr] INFO: Saving data for 1877895: {'created_time': 1769630567.126603, 'last_price_update_time': 1769630567.126617, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877895') HTTP/1.1" 204 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/2.jpg not downloaded yet
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/3.jpg not downloaded yet
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/4.jpg not downloaded yet
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/5.jpg not downloaded yet
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/6.jpg not downloaded yet
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/7.jpg not downloaded yet
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/8.jpg not downloaded yet
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaef9d0>
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg saved to cache
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:47 [ayvens.fr] INFO: Found listing with ID: 1877898
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877898%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [ayvens.fr] INFO: Scrape type for 1877898: 1
2026-01-28 20:02:47 [ayvens.fr] INFO: Extracting data for car ID: 1877898
2026-01-28 20:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 63676611-fb1c-5ea7-a982-8b940cda0181 with identifier: 1877898
2026-01-28 20:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63676611-fb1c-5ea7-a982-8b940cda0181 with scrape type 1
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/1.jpg not downloaded yet
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/2.jpg not downloaded yet
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429fc10>
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg saved to cache
2026-01-28 20:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44662d0>
2026-01-28 20:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg saved to cache
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43748d0>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg saved to cache
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4348250>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg saved to cache
2026-01-28 20:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429ffd0>
2026-01-28 20:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429c410>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/3.jpg not downloaded yet
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/4.jpg not downloaded yet
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/5.jpg not downloaded yet
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/6.jpg not downloaded yet
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4393390>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/4.jpg saved to cache
2026-01-28 20:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40dbf10>
2026-01-28 20:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/6.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/7.jpg not downloaded yet
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44f9d10>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/1.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4392910>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/5.jpg saved to cache
2026-01-28 20:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e3c90>
2026-01-28 20:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/2.jpg saved to cache
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bf5d0>
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/3.jpg saved to cache
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/8.jpg not downloaded yet
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c434ac10>
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F5c989399828942c18dcb3cea9e1c7576%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg saved to cache
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5
2026-01-28 20:02:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5, skipping ID generation
2026-01-28 20:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 with scrape type 1
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 from tracking dictionaries
2026-01-28 20:02:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 sending to next pipeline
2026-01-28 20:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5, identifier: 1877896
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e16d0>
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/7.jpg saved to cache
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 with identifier: 1877896
2026-01-28 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 with identifier: 1877896
2026-01-28 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': 'e-208', 'trim': '208 e-208 136ch active pack', 'title': 'peugeot e-208 208 e-208 136ch active pack', 'price': 0, 'odometer': 34100, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-28', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b11aa82a-ed76-5494-a0b6-7dcdd8273ec5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 423375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 423375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 345381}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 359895}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 350688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 248004}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 563401}], 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'peugeot e-208', 'sanitized_make': 'peugeot', 'odometer_in_km': 34100} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'blanc',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': 'b11aa82a-ed76-5494-a0b6-7dcdd8273ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot e-208',
'model': 'e-208',
'odometer': 34100,
'odometer_in_km': 34100,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot e-208 208 e-208 136ch active pack',
'transmission': 'automatic',
'trim': '208 e-208 136ch active pack',
'vin': None,
'year': 2023}
2026-01-28 20:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 spider: ayvens.fr
2026-01-28 20:02:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: b11aa82a-ed76-5494-a0b6-7dcdd8273ec5 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': 'e-208', 'trim': '208 e-208 136ch active pack', 'title': 'peugeot e-208 208 e-208 136ch active pack', 'price': 0, 'odometer': 34100, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-28', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b11aa82a-ed76-5494-a0b6-7dcdd8273ec5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 423375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 423375}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411977}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 345381}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 359895}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 350688}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 248004}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 563401}], 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'peugeot e-208', 'sanitized_make': 'peugeot', 'odometer_in_km': 34100} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'blanc',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': 'b11aa82a-ed76-5494-a0b6-7dcdd8273ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot e-208',
'model': 'e-208',
'odometer': 34100,
'odometer_in_km': 34100,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot e-208 208 e-208 136ch active pack',
'transmission': 'automatic',
'trim': '208 e-208 136ch active pack',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': 'b11aa82a-ed76-5494-a0b6-7dcdd8273ec5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'E-208',
'odometer': 34100,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359895,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350688,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248004,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b11aa82a-ed76-5494-a0b6-7dcdd8273ec5/b11aa82a-ed76-5494-a0b6-7dcdd8273ec5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 563401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/5c989399828942c18dcb3cea9e1c7576/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT E-208 208 e-208 136ch Active Pack',
'transmission': 'automatic',
'trim': '208 e-208 136ch Active Pack',
'vin': None,
'year': 2023}
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877896%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [ayvens.fr] INFO: Saving data for 1877896: {'created_time': 1769630572.664463, 'last_price_update_time': 1769630572.664473, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877896') HTTP/1.1" 204 0
2026-01-28 20:02:52 [ayvens.fr] INFO: Found listing with ID: 1877899
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877899%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [ayvens.fr] INFO: Scrape type for 1877899: 1
2026-01-28 20:02:52 [ayvens.fr] INFO: Extracting data for car ID: 1877899
2026-01-28 20:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 with identifier: 1877899
2026-01-28 20:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 with scrape type 1
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/1.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/2.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/3.jpg not downloaded yet
2026-01-28 20:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/4.jpg not downloaded yet
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/5.jpg not downloaded yet
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/6.jpg not downloaded yet
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40f6110>
2026-01-28 20:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/1.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e67d0>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/2.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4218ad0>
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252Fe5ba1a9cae994ab6b7f4da11294020d7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/8.jpg saved to cache
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf6476dd-7660-5bb7-9e63-d4958e73699e
2026-01-28 20:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf6476dd-7660-5bb7-9e63-d4958e73699e, skipping ID generation
2026-01-28 20:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf6476dd-7660-5bb7-9e63-d4958e73699e with scrape type 1
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bf6476dd-7660-5bb7-9e63-d4958e73699e from tracking dictionaries
2026-01-28 20:02:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf6476dd-7660-5bb7-9e63-d4958e73699e sending to next pipeline
2026-01-28 20:02:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bf6476dd-7660-5bb7-9e63-d4958e73699e, identifier: 1877897
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b7bd0>
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/4.jpg saved to cache
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/7.jpg not downloaded yet
2026-01-28 20:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bf6476dd-7660-5bb7-9e63-d4958e73699e with identifier: 1877897
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bf6476dd-7660-5bb7-9e63-d4958e73699e with identifier: 1877897
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-28 20:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bf6476dd-7660-5bb7-9e63-d4958e73699e spider: ayvens.fr
2026-01-28 20:02:54 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: bf6476dd-7660-5bb7-9e63-d4958e73699e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
'c_o_2_emission_value': 241,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'bf6476dd-7660-5bb7-9e63-d4958e73699e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'BOXER',
'odometer': 77421,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 373417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332945,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248615,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389919,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf6476dd-7660-5bb7-9e63-d4958e73699e/bf6476dd-7660-5bb7-9e63-d4958e73699e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/e5ba1a9cae994ab6b7f4da11294020d7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT BOXER Boxer Fg 333 L2H2 2.2 BlueHDi S&S 140ch Asphalt',
'transmission': 'manual',
'trim': 'Boxer Fg 333 L2H2 2.2 BlueHDi S&S 140ch Asphalt',
'vin': None,
'year': 2021}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877897%27 HTTP/1.1" 200 None
2026-01-28 20:02:54 [ayvens.fr] INFO: Saving data for 1877897: {'created_time': 1769630574.678671, 'last_price_update_time': 1769630574.678679, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877897') HTTP/1.1" 204 0
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4336950>
2026-01-28 20:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/3.jpg saved to cache
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435a490>
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/6.jpg saved to cache
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/8.jpg not downloaded yet
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43078d0>
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/5.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41569d0>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/8.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [ayvens.fr] INFO: Found listing with ID: 1877900
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877900%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [ayvens.fr] INFO: Scrape type for 1877900: 1
2026-01-28 20:02:56 [ayvens.fr] INFO: Extracting data for car ID: 1877900
2026-01-28 20:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8b365b2-393b-5b0b-b439-5bff01c8ee46 with identifier: 1877900
2026-01-28 20:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b365b2-393b-5b0b-b439-5bff01c8ee46 with scrape type 1
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/1.jpg not downloaded yet
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/2.jpg not downloaded yet
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4393390>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/1.jpg saved to cache
2026-01-28 20:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4506890>
2026-01-28 20:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/2.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/3.jpg not downloaded yet
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/4.jpg not downloaded yet
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435d850>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fc26a9389fc0c43c89e053305e83649b4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/7.jpg saved to cache
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 63676611-fb1c-5ea7-a982-8b940cda0181
2026-01-28 20:02:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 63676611-fb1c-5ea7-a982-8b940cda0181, skipping ID generation
2026-01-28 20:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 63676611-fb1c-5ea7-a982-8b940cda0181 with scrape type 1
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 63676611-fb1c-5ea7-a982-8b940cda0181 from tracking dictionaries
2026-01-28 20:02:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 63676611-fb1c-5ea7-a982-8b940cda0181 sending to next pipeline
2026-01-28 20:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 63676611-fb1c-5ea7-a982-8b940cda0181, identifier: 1877898
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4465b50>
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/4.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41990d0>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/3.jpg saved to cache
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/5.jpg not downloaded yet
2026-01-28 20:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 63676611-fb1c-5ea7-a982-8b940cda0181 with identifier: 1877898
2026-01-28 20:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 63676611-fb1c-5ea7-a982-8b940cda0181 with identifier: 1877898
2026-01-28 20:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 63676611-fb1c-5ea7-a982-8b940cda0181 with identifier: 1877898 to the API
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '63676611-fb1c-5ea7-a982-8b940cda0181',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 47913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 463257,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 489442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443301,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_63676611-fb1c-5ea7-a982-8b940cda0181/63676611-fb1c-5ea7-a982-8b940cda0181_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/c26a9389fc0c43c89e053305e83649b4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-15',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2022}
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877898%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [ayvens.fr] INFO: Saving data for 1877898: {'created_time': 1769630578.833978, 'last_price_update_time': 1769630578.833988, 'auction_closing_time': 1769695200.0}
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877898') HTTP/1.1" 204 0
2026-01-28 20:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/6.jpg not downloaded yet
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d1d10>
2026-01-28 20:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/5.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45342d0>
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/6.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff36090>
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/7.jpg saved to cache
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/7.jpg not downloaded yet
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416ded0>
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Ffaef7fb4599e4be980e54ed154bab387%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/8.jpg saved to cache
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4
2026-01-28 20:03:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4, skipping ID generation
2026-01-28 20:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 with scrape type 1
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 from tracking dictionaries
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 sending to next pipeline
2026-01-28 20:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4, identifier: 1877899
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/8.jpg not downloaded yet
2026-01-28 20:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 with identifier: 1877899
2026-01-28 20:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 with identifier: 1877899
2026-01-28 20:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 98b09a1f-e080-5b45-8fb5-4f5610b0d1d4 with identifier: 1877899 to the API
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '98b09a1f-e080-5b45-8fb5-4f5610b0d1d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 56306,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297416,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336992,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355764,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300994,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98b09a1f-e080-5b45-8fb5-4f5610b0d1d4/98b09a1f-e080-5b45-8fb5-4f5610b0d1d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288737,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/faef7fb4599e4be980e54ed154bab387/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-19',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Sté 1.0 SCe 75ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Sté 1.0 SCe 75ch Air Nav',
'vin': None,
'year': 2020}
2026-01-28 20:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877899%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [ayvens.fr] INFO: Saving data for 1877899: {'created_time': 1769630581.045881, 'last_price_update_time': 1769630581.045892, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877899') HTTP/1.1" 204 0
2026-01-28 20:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:01 [ayvens.fr] INFO: Found listing with ID: 1877901
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877901%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [ayvens.fr] INFO: Scrape type for 1877901: 1
2026-01-28 20:03:01 [ayvens.fr] INFO: Extracting data for car ID: 1877901
2026-01-28 20:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8d66566-f5d4-56c4-b348-11fd32e0faea with identifier: 1877901
2026-01-28 20:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d66566-f5d4-56c4-b348-11fd32e0faea with scrape type 1
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg not downloaded yet
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff17e50>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/1.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412b750>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/2.jpg saved to cache
2026-01-28 20:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff29210>
2026-01-28 20:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/3.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg not downloaded yet
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg not downloaded yet
2026-01-28 20:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4199510>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/4.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg not downloaded yet
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg not downloaded yet
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45059d0>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/5.jpg saved to cache
2026-01-28 20:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4472a10>
2026-01-28 20:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/6.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfb310d0>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/7.jpg saved to cache
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [ayvens.fr] INFO: Found listing with ID: 1877902
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877902%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [ayvens.fr] INFO: Scrape type for 1877902: 1
2026-01-28 20:03:03 [ayvens.fr] INFO: Extracting data for car ID: 1877902
2026-01-28 20:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67f57076-427c-53e9-b123-1780968cb8a5 with identifier: 1877902
2026-01-28 20:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f57076-427c-53e9-b123-1780968cb8a5 with scrape type 1
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/1.jpg not downloaded yet
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/2.jpg not downloaded yet
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/3.jpg not downloaded yet
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/4.jpg not downloaded yet
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/5.jpg not downloaded yet
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425c7d0>
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/6.jpg not downloaded yet
2026-01-28 20:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d27d0>
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fce4b0755d7834cdba4938280110a4976%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/8.jpg saved to cache
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a8b365b2-393b-5b0b-b439-5bff01c8ee46
2026-01-28 20:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a8b365b2-393b-5b0b-b439-5bff01c8ee46, skipping ID generation
2026-01-28 20:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8b365b2-393b-5b0b-b439-5bff01c8ee46 with scrape type 1
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a8b365b2-393b-5b0b-b439-5bff01c8ee46 from tracking dictionaries
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a8b365b2-393b-5b0b-b439-5bff01c8ee46 sending to next pipeline
2026-01-28 20:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a8b365b2-393b-5b0b-b439-5bff01c8ee46, identifier: 1877900
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/7.jpg not downloaded yet
2026-01-28 20:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a8b365b2-393b-5b0b-b439-5bff01c8ee46 with identifier: 1877900
2026-01-28 20:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a8b365b2-393b-5b0b-b439-5bff01c8ee46 with identifier: 1877900
2026-01-28 20:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
2026-01-28 20:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a8b365b2-393b-5b0b-b439-5bff01c8ee46 spider: ayvens.fr
2026-01-28 20:03:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: a8b365b2-393b-5b0b-b439-5bff01c8ee46 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'master' containing 'master'
{'auction_title': '',
'c_o_2_emission_value': 154,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'a8b365b2-393b-5b0b-b439-5bff01c8ee46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MASTER',
'odometer': 121825,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282380,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239888,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277854,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263286,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301360,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a8b365b2-393b-5b0b-b439-5bff01c8ee46/a8b365b2-393b-5b0b-b439-5bff01c8ee46_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449293,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ce4b0755d7834cdba4938280110a4976/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-25',
'seats_number': 3,
'seller_name': None,
'title': 'RENAULT MASTER Master Fg F3500 L2H2 2.3 dCi 150ch Energy Grand '
'Confort E6',
'transmission': 'manual',
'trim': 'Master Fg F3500 L2H2 2.3 dCi 150ch Energy Grand Confort E6',
'vin': None,
'year': 2020}
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877900%27 HTTP/1.1" 200 None
2026-01-28 20:03:04 [ayvens.fr] INFO: Saving data for 1877900: {'created_time': 1769630584.96228, 'last_price_update_time': 1769630584.96229, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877900') HTTP/1.1" 204 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/8.jpg not downloaded yet
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41e4a90>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4465f10>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4519850>
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg saved to cache
2026-01-28 20:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:05 [ayvens.fr] INFO: Found listing with ID: 1877903
2026-01-28 20:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877903%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [ayvens.fr] INFO: Scrape type for 1877903: 1
2026-01-28 20:03:06 [ayvens.fr] INFO: Extracting data for car ID: 1877903
2026-01-28 20:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4126a5de-5649-5511-bc57-029f1bbe08d9 with identifier: 1877903
2026-01-28 20:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4126a5de-5649-5511-bc57-029f1bbe08d9 with scrape type 1
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/1.jpg not downloaded yet
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/2.jpg not downloaded yet
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/3.jpg not downloaded yet
2026-01-28 20:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/4.jpg not downloaded yet
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e5090>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaef350>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg saved to cache
2026-01-28 20:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e4e50>
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fd505fd794082458c87c1afde3a60436d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e8d66566-f5d4-56c4-b348-11fd32e0faea
2026-01-28 20:03:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e8d66566-f5d4-56c4-b348-11fd32e0faea, skipping ID generation
2026-01-28 20:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8d66566-f5d4-56c4-b348-11fd32e0faea with scrape type 1
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e8d66566-f5d4-56c4-b348-11fd32e0faea from tracking dictionaries
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e8d66566-f5d4-56c4-b348-11fd32e0faea sending to next pipeline
2026-01-28 20:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e8d66566-f5d4-56c4-b348-11fd32e0faea, identifier: 1877901
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/5.jpg not downloaded yet
2026-01-28 20:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e8d66566-f5d4-56c4-b348-11fd32e0faea with identifier: 1877901
2026-01-28 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e8d66566-f5d4-56c4-b348-11fd32e0faea with identifier: 1877901
2026-01-28 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 7, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 83ch feel business r', 'title': 'citroën c3 c3 ste 1.2 puretech 83ch feel business r', 'price': 0, 'odometer': 78984, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-30', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 123, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e8d66566-f5d4-56c4-b348-11fd32e0faea', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 361865}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 361865}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 389667}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 348368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323509}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 288803}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 397786}], 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 78984}
Failed validating None in schema:
False
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'e8d66566-f5d4-56c4-b348-11fd32e0faea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 78984,
'odometer_in_km': 78984,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 7,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 83ch feel business r',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 83ch feel business r',
'vin': None,
'year': 2022}
2026-01-28 20:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: e8d66566-f5d4-56c4-b348-11fd32e0faea spider: ayvens.fr
2026-01-28 20:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: e8d66566-f5d4-56c4-b348-11fd32e0faea due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 7, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 83ch feel business r', 'title': 'citroën c3 c3 ste 1.2 puretech 83ch feel business r', 'price': 0, 'odometer': 78984, 'odometer_reading_unit': 'km', 'registration_date': '2022-11-30', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 123, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'e8d66566-f5d4-56c4-b348-11fd32e0faea', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 361865}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 361865}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 389667}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 348368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323509}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 288803}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 397786}], 'current_year_diff': 4, 'age_in_months': 37, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 78984}
Failed validating None in schema:
False
On instance:
{'age_in_months': 37,
'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'e8d66566-f5d4-56c4-b348-11fd32e0faea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 78984,
'odometer_in_km': 78984,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 7,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 83ch feel business r',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 83ch feel business r',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'e8d66566-f5d4-56c4-b348-11fd32e0faea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 78984,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 7,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361865,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288803,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e8d66566-f5d4-56c4-b348-11fd32e0faea/e8d66566-f5d4-56c4-b348-11fd32e0faea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397786,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/d505fd794082458c87c1afde3a60436d/images/large/7.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-30',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.2 PureTech 83ch Feel Business R',
'transmission': 'manual',
'trim': 'C3 Ste 1.2 PureTech 83ch Feel Business R',
'vin': None,
'year': 2022}
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877901%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [ayvens.fr] INFO: Saving data for 1877901: {'created_time': 1769630587.502371, 'last_price_update_time': 1769630587.502382, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877901') HTTP/1.1" 204 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/6.jpg not downloaded yet
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441af90>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/2.jpg saved to cache
2026-01-28 20:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441a950>
2026-01-28 20:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/1.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441ae50>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/3.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfac2e10>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/4.jpg saved to cache
2026-01-28 20:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42941d0>
2026-01-28 20:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/5.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/7.jpg not downloaded yet
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/8.jpg not downloaded yet
2026-01-28 20:03:09 [ayvens.fr] INFO: Found listing with ID: 1877904
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877904%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [ayvens.fr] INFO: Scrape type for 1877904: 1
2026-01-28 20:03:09 [ayvens.fr] INFO: Extracting data for car ID: 1877904
2026-01-28 20:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acabec27-90f3-5988-a1e8-5c8259214267 with identifier: 1877904
2026-01-28 20:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acabec27-90f3-5988-a1e8-5c8259214267 with scrape type 1
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg not downloaded yet
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg not downloaded yet
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg not downloaded yet
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406e190>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/6.jpg saved to cache
2026-01-28 20:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44fa010>
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/7.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4128fd0>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/1.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429f2d0>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgb-%252F0b8464a044e84c31ba3cd8c94efba7a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/8.jpg saved to cache
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67f57076-427c-53e9-b123-1780968cb8a5
2026-01-28 20:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67f57076-427c-53e9-b123-1780968cb8a5, skipping ID generation
2026-01-28 20:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67f57076-427c-53e9-b123-1780968cb8a5 with scrape type 1
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 67f57076-427c-53e9-b123-1780968cb8a5 from tracking dictionaries
2026-01-28 20:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67f57076-427c-53e9-b123-1780968cb8a5 sending to next pipeline
2026-01-28 20:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 67f57076-427c-53e9-b123-1780968cb8a5, identifier: 1877902
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e0750>
2026-01-28 20:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/2.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg not downloaded yet
2026-01-28 20:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 67f57076-427c-53e9-b123-1780968cb8a5 with identifier: 1877902
2026-01-28 20:03:11 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 67f57076-427c-53e9-b123-1780968cb8a5 with identifier: 1877902
2026-01-28 20:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134950 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
134950
2026-01-28 20:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 67f57076-427c-53e9-b123-1780968cb8a5 spider: ayvens.fr
2026-01-28 20:03:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 67f57076-427c-53e9-b123-1780968cb8a5 due to rule: high_mileage_for_make.json, error: 134950 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
134950
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '67f57076-427c-53e9-b123-1780968cb8a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '508',
'odometer': 134950,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 521496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385653,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369297,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260842,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67f57076-427c-53e9-b123-1780968cb8a5/67f57076-427c-53e9-b123-1780968cb8a5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342381,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gb-/0b8464a044e84c31ba3cd8c94efba7a7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-01',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 508 508 SW BlueHDi 130ch S&S Allure Business EAT8',
'transmission': 'automatic',
'trim': '508 SW BlueHDi 130ch S&S Allure Business EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877902%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [ayvens.fr] INFO: Saving data for 1877902: {'created_time': 1769630591.544463, 'last_price_update_time': 1769630591.544478, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877902') HTTP/1.1" 204 0
2026-01-28 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg not downloaded yet
2026-01-28 20:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4143210>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/4.jpg saved to cache
2026-01-28 20:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4588090>
2026-01-28 20:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/3.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg not downloaded yet
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg not downloaded yet
2026-01-28 20:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45a94d0>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/5.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41d9990>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/6.jpg saved to cache
2026-01-28 20:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40f6a10>
2026-01-28 20:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/8.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg not downloaded yet
2026-01-28 20:03:13 [ayvens.fr] INFO: Found listing with ID: 1877905
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877905%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [ayvens.fr] INFO: Scrape type for 1877905: 1
2026-01-28 20:03:13 [ayvens.fr] INFO: Extracting data for car ID: 1877905
2026-01-28 20:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da37f1c9-64b4-5693-beef-af12b7cb5ae6 with identifier: 1877905
2026-01-28 20:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da37f1c9-64b4-5693-beef-af12b7cb5ae6 with scrape type 1
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/1.jpg not downloaded yet
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ce590>
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252Fb4d3ca22017a4f62bf1c1025a3ae6f7b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/7.jpg saved to cache
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4126a5de-5649-5511-bc57-029f1bbe08d9
2026-01-28 20:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4126a5de-5649-5511-bc57-029f1bbe08d9, skipping ID generation
2026-01-28 20:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4126a5de-5649-5511-bc57-029f1bbe08d9 with scrape type 1
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4126a5de-5649-5511-bc57-029f1bbe08d9 from tracking dictionaries
2026-01-28 20:03:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4126a5de-5649-5511-bc57-029f1bbe08d9 sending to next pipeline
2026-01-28 20:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4126a5de-5649-5511-bc57-029f1bbe08d9, identifier: 1877903
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45888d0>
2026-01-28 20:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/2.jpg not downloaded yet
2026-01-28 20:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4126a5de-5649-5511-bc57-029f1bbe08d9 with identifier: 1877903
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4126a5de-5649-5511-bc57-029f1bbe08d9 with identifier: 1877903
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4126a5de-5649-5511-bc57-029f1bbe08d9 spider: ayvens.fr
2026-01-28 20:03:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 4126a5de-5649-5511-bc57-029f1bbe08d9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '4126a5de-5649-5511-bc57-029f1bbe08d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 132107,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376612,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 283930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314573,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4126a5de-5649-5511-bc57-029f1bbe08d9/4126a5de-5649-5511-bc57-029f1bbe08d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209485,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/b4d3ca22017a4f62bf1c1025a3ae6f7b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-07-06',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express 1.5 Blue dCi 80ch Grand '
'Confort 5cv',
'transmission': 'manual',
'trim': 'Kangoo Express 1.5 Blue dCi 80ch Grand Confort 5cv',
'vin': None,
'year': 2021}
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877903%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [ayvens.fr] INFO: Saving data for 1877903: {'created_time': 1769630594.366768, 'last_price_update_time': 1769630594.366781, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877903') HTTP/1.1" 204 0
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dc490>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg saved to cache
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/3.jpg not downloaded yet
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45378d0>
2026-01-28 20:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/4.jpg not downloaded yet
2026-01-28 20:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/5.jpg not downloaded yet
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4140310>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff516d0>
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg saved to cache
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/6.jpg not downloaded yet
2026-01-28 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/7.jpg not downloaded yet
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4199410>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4230810>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg saved to cache
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/8.jpg not downloaded yet
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c5f23b90>
2026-01-28 20:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F68d18c4ef3f34f6daed68902875de526%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg saved to cache
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acabec27-90f3-5988-a1e8-5c8259214267
2026-01-28 20:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acabec27-90f3-5988-a1e8-5c8259214267, skipping ID generation
2026-01-28 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acabec27-90f3-5988-a1e8-5c8259214267 with scrape type 1
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item acabec27-90f3-5988-a1e8-5c8259214267 from tracking dictionaries
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acabec27-90f3-5988-a1e8-5c8259214267 sending to next pipeline
2026-01-28 20:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: acabec27-90f3-5988-a1e8-5c8259214267, identifier: 1877904
2026-01-28 20:03:17 [ayvens.fr] INFO: Found listing with ID: 1877906
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877906%27 HTTP/1.1" 200 None
2026-01-28 20:03:17 [ayvens.fr] INFO: Scrape type for 1877906: 1
2026-01-28 20:03:17 [ayvens.fr] INFO: Extracting data for car ID: 1877906
2026-01-28 20:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 with identifier: 1877906
2026-01-28 20:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 with scrape type 1
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/1.jpg not downloaded yet
2026-01-28 20:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: acabec27-90f3-5988-a1e8-5c8259214267 with identifier: 1877904
2026-01-28 20:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: acabec27-90f3-5988-a1e8-5c8259214267 with identifier: 1877904
2026-01-28 20:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': '2008 1.2 puretech 100ch s&s active pack', 'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s active pack', 'price': 0, 'odometer': 63158, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-25', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 124, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'acabec27-90f3-5988-a1e8-5c8259214267', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 446013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 446013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 509863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 390509}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 356519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 388368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 208492}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 556707}], 'current_year_diff': 3, 'age_in_months': 29, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63158}
Failed validating None in schema:
False
On instance:
{'age_in_months': 29,
'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'acabec27-90f3-5988-a1e8-5c8259214267',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 63158,
'odometer_in_km': 63158,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s active pack',
'transmission': 'manual',
'trim': '2008 1.2 puretech 100ch s&s active pack',
'vin': None,
'year': 2023}
2026-01-28 20:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: acabec27-90f3-5988-a1e8-5c8259214267 spider: ayvens.fr
2026-01-28 20:03:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: acabec27-90f3-5988-a1e8-5c8259214267 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '2008', 'trim': '2008 1.2 puretech 100ch s&s active pack', 'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s active pack', 'price': 0, 'odometer': 63158, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-25', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 124, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'acabec27-90f3-5988-a1e8-5c8259214267', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 446013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 446013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 509863}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 390509}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 356519}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 388368}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 208492}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 556707}], 'current_year_diff': 3, 'age_in_months': 29, 'make_model': 'peugeot 2008', 'sanitized_make': 'peugeot', 'odometer_in_km': 63158}
Failed validating None in schema:
False
On instance:
{'age_in_months': 29,
'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'acabec27-90f3-5988-a1e8-5c8259214267',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 2008',
'model': '2008',
'odometer': 63158,
'odometer_in_km': 63158,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-25',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 2008 2008 1.2 puretech 100ch s&s active pack',
'transmission': 'manual',
'trim': '2008 1.2 puretech 100ch s&s active pack',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 124,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'acabec27-90f3-5988-a1e8-5c8259214267',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 63158,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 509863,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390509,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388368,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208492,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acabec27-90f3-5988-a1e8-5c8259214267/acabec27-90f3-5988-a1e8-5c8259214267_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 556707,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/68d18c4ef3f34f6daed68902875de526/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-25',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.2 PureTech 100ch S&S Active Pack',
'transmission': 'manual',
'trim': '2008 1.2 PureTech 100ch S&S Active Pack',
'vin': None,
'year': 2023}
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877904%27 HTTP/1.1" 200 None
2026-01-28 20:03:17 [ayvens.fr] INFO: Saving data for 1877904: {'created_time': 1769630597.576387, 'last_price_update_time': 1769630597.576399, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877904') HTTP/1.1" 204 0
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/2.jpg not downloaded yet
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4536f90>
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/1.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/3.jpg not downloaded yet
2026-01-28 20:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/4.jpg not downloaded yet
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4283e90>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/3.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4336610>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/2.jpg saved to cache
2026-01-28 20:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaecbd0>
2026-01-28 20:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/5.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/5.jpg not downloaded yet
2026-01-28 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaecb10>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/4.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4231850>
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/6.jpg saved to cache
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/6.jpg not downloaded yet
2026-01-28 20:03:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/7.jpg not downloaded yet
2026-01-28 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a5e10>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/7.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/8.jpg not downloaded yet
2026-01-28 20:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:20 [ayvens.fr] INFO: Found listing with ID: 1877907
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877907%27 HTTP/1.1" 200 None
2026-01-28 20:03:20 [ayvens.fr] INFO: Scrape type for 1877907: 1
2026-01-28 20:03:20 [ayvens.fr] INFO: Extracting data for car ID: 1877907
2026-01-28 20:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e518012-1ace-5382-99ea-19df86a13b53 with identifier: 1877907
2026-01-28 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e518012-1ace-5382-99ea-19df86a13b53 with scrape type 1
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg not downloaded yet
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff50750>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252Ff77819cdec254512ad4695aab0784478%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/8.jpg saved to cache
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da37f1c9-64b4-5693-beef-af12b7cb5ae6
2026-01-28 20:03:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da37f1c9-64b4-5693-beef-af12b7cb5ae6, skipping ID generation
2026-01-28 20:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item da37f1c9-64b4-5693-beef-af12b7cb5ae6 with scrape type 1
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item da37f1c9-64b4-5693-beef-af12b7cb5ae6 from tracking dictionaries
2026-01-28 20:03:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da37f1c9-64b4-5693-beef-af12b7cb5ae6 sending to next pipeline
2026-01-28 20:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: da37f1c9-64b4-5693-beef-af12b7cb5ae6, identifier: 1877905
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4337ad0>
2026-01-28 20:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/1.jpg saved to cache
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4280790>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/2.jpg saved to cache
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg not downloaded yet
2026-01-28 20:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: da37f1c9-64b4-5693-beef-af12b7cb5ae6 with identifier: 1877905
2026-01-28 20:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: da37f1c9-64b4-5693-beef-af12b7cb5ae6 with identifier: 1877905
2026-01-28 20:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132588 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
132588
2026-01-28 20:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: da37f1c9-64b4-5693-beef-af12b7cb5ae6 spider: ayvens.fr
2026-01-28 20:03:21 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: da37f1c9-64b4-5693-beef-af12b7cb5ae6 due to rule: high_mileage_for_make.json, error: 132588 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
132588
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'da37f1c9-64b4-5693-beef-af12b7cb5ae6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 132588,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416977,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312951,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da37f1c9-64b4-5693-beef-af12b7cb5ae6/da37f1c9-64b4-5693-beef-af12b7cb5ae6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 510261,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/f77819cdec254512ad4695aab0784478/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-16',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch E6.c Active Business S&S EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch E6.c Active Business S&S EAT8',
'vin': None,
'year': 2020}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877905%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [ayvens.fr] INFO: Saving data for 1877905: {'created_time': 1769630601.707505, 'last_price_update_time': 1769630601.707514, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877905') HTTP/1.1" 204 0
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg not downloaded yet
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dcd90>
2026-01-28 20:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/3.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg not downloaded yet
2026-01-28 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg not downloaded yet
2026-01-28 20:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff52d50>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/4.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4315290>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/5.jpg saved to cache
2026-01-28 20:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407e950>
2026-01-28 20:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/6.jpg saved to cache
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg not downloaded yet
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg not downloaded yet
2026-01-28 20:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417f6d0>
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/7.jpg saved to cache
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425c2d0>
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F90933e4e591f400da4cc487e4ac1dfe4%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/8.jpg saved to cache
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299
2026-01-28 20:03:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed29ae8a-b45a-5297-9d4b-d4db0ab3a299, skipping ID generation
2026-01-28 20:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 with scrape type 1
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 from tracking dictionaries
2026-01-28 20:03:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 sending to next pipeline
2026-01-28 20:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ed29ae8a-b45a-5297-9d4b-d4db0ab3a299, identifier: 1877906
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg not downloaded yet
2026-01-28 20:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 with identifier: 1877906
2026-01-28 20:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 with identifier: 1877906
2026-01-28 20:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: ed29ae8a-b45a-5297-9d4b-d4db0ab3a299 with identifier: 1877906 to the API
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 125,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'ed29ae8a-b45a-5297-9d4b-d4db0ab3a299',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 103995,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356834,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329122,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397626,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284409,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301346,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed29ae8a-b45a-5297-9d4b-d4db0ab3a299/ed29ae8a-b45a-5297-9d4b-d4db0ab3a299_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334036,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/90933e4e591f400da4cc487e4ac1dfe4/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-06',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 SW 308 SW 1.5 BlueHDi 130ch S&S Allure EAT8 7cv',
'transmission': 'automatic',
'trim': '308 SW 1.5 BlueHDi 130ch S&S Allure EAT8 7cv',
'vin': None,
'year': 2020}
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877906%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [ayvens.fr] INFO: Saving data for 1877906: {'created_time': 1769630604.557594, 'last_price_update_time': 1769630604.557609, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877906') HTTP/1.1" 204 0
2026-01-28 20:03:24 [ayvens.fr] INFO: Found listing with ID: 1877908
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877908%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [ayvens.fr] INFO: Scrape type for 1877908: 1
2026-01-28 20:03:24 [ayvens.fr] INFO: Extracting data for car ID: 1877908
2026-01-28 20:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f5952d6-99ff-5f17-990a-57a74f4f23b3 with identifier: 1877908
2026-01-28 20:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3 with scrape type 1
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg not downloaded yet
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45bbbd0>
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg saved to cache
2026-01-28 20:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg not downloaded yet
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg not downloaded yet
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454ddd0>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg saved to cache
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cc7d0>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg saved to cache
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg not downloaded yet
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg not downloaded yet
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419c2d0>
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4335090>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4587790>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg not downloaded yet
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg not downloaded yet
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458ad10>
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg saved to cache
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg not downloaded yet
2026-01-28 20:03:27 [ayvens.fr] INFO: Found listing with ID: 1877909
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877909%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [ayvens.fr] INFO: Scrape type for 1877909: 1
2026-01-28 20:03:27 [ayvens.fr] INFO: Extracting data for car ID: 1877909
2026-01-28 20:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e with identifier: 1877909
2026-01-28 20:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e with scrape type 1
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/1.jpg not downloaded yet
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/2.jpg not downloaded yet
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/3.jpg not downloaded yet
2026-01-28 20:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/4.jpg not downloaded yet
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4467e10>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fff-%252F3060ebbe63934fce97b0500a4ed9802d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e518012-1ace-5382-99ea-19df86a13b53
2026-01-28 20:03:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e518012-1ace-5382-99ea-19df86a13b53, skipping ID generation
2026-01-28 20:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e518012-1ace-5382-99ea-19df86a13b53 with scrape type 1
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6e518012-1ace-5382-99ea-19df86a13b53 from tracking dictionaries
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e518012-1ace-5382-99ea-19df86a13b53 sending to next pipeline
2026-01-28 20:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6e518012-1ace-5382-99ea-19df86a13b53, identifier: 1877907
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458ac10>
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg saved to cache
2026-01-28 20:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/5.jpg not downloaded yet
2026-01-28 20:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6e518012-1ace-5382-99ea-19df86a13b53 with identifier: 1877907
2026-01-28 20:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6e518012-1ace-5382-99ea-19df86a13b53 with identifier: 1877907
2026-01-28 20:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 82ch e6.c active business s&s 5p', 'title': 'peugeot 208 208 1.2 puretech 82ch e6.c active business s&s 5p', 'price': 0, 'odometer': 25488, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-28', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 108, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6e518012-1ace-5382-99ea-19df86a13b53', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 438887}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 438887}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 444305}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 389601}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329849}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335699}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 257630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 462983}], 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 25488}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '6e518012-1ace-5382-99ea-19df86a13b53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 25488,
'odometer_in_km': 25488,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 82ch e6.c active business s&s '
'5p',
'transmission': 'manual',
'trim': '208 1.2 puretech 82ch e6.c active business s&s 5p',
'vin': None,
'year': 2019}
2026-01-28 20:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6e518012-1ace-5382-99ea-19df86a13b53 spider: ayvens.fr
2026-01-28 20:03:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6e518012-1ace-5382-99ea-19df86a13b53 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 82ch e6.c active business s&s 5p', 'title': 'peugeot 208 208 1.2 puretech 82ch e6.c active business s&s 5p', 'price': 0, 'odometer': 25488, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-28', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 108, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6e518012-1ace-5382-99ea-19df86a13b53', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 438887}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 438887}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 444305}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 389601}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329849}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335699}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 257630}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 462983}], 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 25488}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '6e518012-1ace-5382-99ea-19df86a13b53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 25488,
'odometer_in_km': 25488,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 82ch e6.c active business s&s '
'5p',
'transmission': 'manual',
'trim': '208 1.2 puretech 82ch e6.c active business s&s 5p',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '6e518012-1ace-5382-99ea-19df86a13b53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 25488,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438887,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444305,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389601,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329849,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335699,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257630,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e518012-1ace-5382-99ea-19df86a13b53/6e518012-1ace-5382-99ea-19df86a13b53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 462983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ff-/3060ebbe63934fce97b0500a4ed9802d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 82ch E6.c Active Business S&S 5p',
'transmission': 'manual',
'trim': '208 1.2 PureTech 82ch E6.c Active Business S&S 5p',
'vin': None,
'year': 2019}
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877907%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [ayvens.fr] INFO: Saving data for 1877907: {'created_time': 1769630608.254734, 'last_price_update_time': 1769630608.254748, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877907') HTTP/1.1" 204 0
2026-01-28 20:03:28 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 1 pages/min), scraped 16 items (at 6 items/min)
2026-01-28 20:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/6.jpg not downloaded yet
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418e1d0>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg saved to cache
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e2290>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg saved to cache
2026-01-28 20:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41faf50>
2026-01-28 20:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417ec10>
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/7.jpg not downloaded yet
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419dfd0>
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg saved to cache
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/8.jpg not downloaded yet
2026-01-28 20:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:29 [ayvens.fr] INFO: Found listing with ID: 1877910
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877910%27 HTTP/1.1" 200 None
2026-01-28 20:03:29 [ayvens.fr] INFO: Scrape type for 1877910: 1
2026-01-28 20:03:29 [ayvens.fr] INFO: Extracting data for car ID: 1877910
2026-01-28 20:03:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23f3ecab-98b4-55c1-a547-45e0e521c523 with identifier: 1877910
2026-01-28 20:03:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f3ecab-98b4-55c1-a547-45e0e521c523 with scrape type 1
2026-01-28 20:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/1.jpg not downloaded yet
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c7910>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418f190>
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb7db433166804b718788338b1ff3096e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg saved to cache
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3
2026-01-28 20:03:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7f5952d6-99ff-5f17-990a-57a74f4f23b3, skipping ID generation
2026-01-28 20:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3 with scrape type 1
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7f5952d6-99ff-5f17-990a-57a74f4f23b3 from tracking dictionaries
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7f5952d6-99ff-5f17-990a-57a74f4f23b3 sending to next pipeline
2026-01-28 20:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 7f5952d6-99ff-5f17-990a-57a74f4f23b3, identifier: 1877908
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/2.jpg not downloaded yet
2026-01-28 20:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 7f5952d6-99ff-5f17-990a-57a74f4f23b3 with identifier: 1877908
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 7f5952d6-99ff-5f17-990a-57a74f4f23b3 with identifier: 1877908
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '5008', 'trim': '5008 1.2 puretech 130ch s&s active pack eat8', 'title': 'peugeot 5008 5008 1.2 puretech 130ch s&s active pack eat8', 'price': 0, 'odometer': 137702, 'odometer_reading_unit': 'km', 'registration_date': '2023-02-07', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 149, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '7f5952d6-99ff-5f17-990a-57a74f4f23b3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 493491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 493491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 459096}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 367110}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 398748}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339533}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 269521}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301648}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 137702}
Failed validating None in schema:
False
On instance:
{'age_in_months': 35,
'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '7f5952d6-99ff-5f17-990a-57a74f4f23b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 137702,
'odometer_in_km': 137702,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-07',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 5008 1.2 puretech 130ch s&s active pack eat8',
'transmission': 'automatic',
'trim': '5008 1.2 puretech 130ch s&s active pack eat8',
'vin': None,
'year': 2023}
2026-01-28 20:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 7f5952d6-99ff-5f17-990a-57a74f4f23b3 spider: ayvens.fr
2026-01-28 20:03:31 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 7f5952d6-99ff-5f17-990a-57a74f4f23b3 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '5008', 'trim': '5008 1.2 puretech 130ch s&s active pack eat8', 'title': 'peugeot 5008 5008 1.2 puretech 130ch s&s active pack eat8', 'price': 0, 'odometer': 137702, 'odometer_reading_unit': 'km', 'registration_date': '2023-02-07', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 149, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '7f5952d6-99ff-5f17-990a-57a74f4f23b3', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 493491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 493491}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 459096}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 367110}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 398748}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339533}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 269521}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301648}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'peugeot 5008', 'sanitized_make': 'peugeot', 'odometer_in_km': 137702}
Failed validating None in schema:
False
On instance:
{'age_in_months': 35,
'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '7f5952d6-99ff-5f17-990a-57a74f4f23b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 5008',
'model': '5008',
'odometer': 137702,
'odometer_in_km': 137702,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-07',
'sanitized_make': 'peugeot',
'seats_number': 7,
'seller_name': None,
'title': 'peugeot 5008 5008 1.2 puretech 130ch s&s active pack eat8',
'transmission': 'automatic',
'trim': '5008 1.2 puretech 130ch s&s active pack eat8',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '7f5952d6-99ff-5f17-990a-57a74f4f23b3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 137702,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 493491,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 459096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339533,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269521,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7f5952d6-99ff-5f17-990a-57a74f4f23b3/7f5952d6-99ff-5f17-990a-57a74f4f23b3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b7db433166804b718788338b1ff3096e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-07',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.2 PureTech 130ch S&S Active Pack EAT8',
'vin': None,
'year': 2023}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877908%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [ayvens.fr] INFO: Saving data for 1877908: {'created_time': 1769630611.407078, 'last_price_update_time': 1769630611.407091, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877908') HTTP/1.1" 204 0
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/3.jpg not downloaded yet
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4305f90>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/4.jpg saved to cache
2026-01-28 20:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4484a10>
2026-01-28 20:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/2.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4485010>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/1.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/4.jpg not downloaded yet
2026-01-28 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/5.jpg not downloaded yet
2026-01-28 20:03:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41601d0>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/5.jpg saved to cache
2026-01-28 20:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bcfd0>
2026-01-28 20:03:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/3.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/6.jpg not downloaded yet
2026-01-28 20:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/7.jpg not downloaded yet
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435afd0>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/6.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425cad0>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/8.jpg saved to cache
2026-01-28 20:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4282cd0>
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fadddde1c1c97424aaa36cf3a86c99d82%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/7.jpg saved to cache
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e, skipping ID generation
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e from tracking dictionaries
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e sending to next pipeline
2026-01-28 20:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e, identifier: 1877909
2026-01-28 20:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e with identifier: 1877909
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e with identifier: 1877909
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e spider: ayvens.fr
2026-01-28 20:03:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 4fc4d463-007b-5ad2-8d6a-3111d0b31e5e due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '4fc4d463-007b-5ad2-8d6a-3111d0b31e5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 125373,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 534696,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 565276,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308621,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340905,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4fc4d463-007b-5ad2-8d6a-3111d0b31e5e/4fc4d463-007b-5ad2-8d6a-3111d0b31e5e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294787,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/adddde1c1c97424aaa36cf3a86c99d82/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-11',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Sté 1.5 Blue dCi 85ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Sté 1.5 Blue dCi 85ch Air Nav',
'vin': None,
'year': 2020}
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877909%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [ayvens.fr] INFO: Saving data for 1877909: {'created_time': 1769630614.486813, 'last_price_update_time': 1769630614.486823, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877909') HTTP/1.1" 204 0
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/8.jpg not downloaded yet
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e6210>
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/1.jpg saved to cache
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:34 [ayvens.fr] INFO: Found listing with ID: 1877911
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877911%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [ayvens.fr] INFO: Scrape type for 1877911: 1
2026-01-28 20:03:34 [ayvens.fr] INFO: Extracting data for car ID: 1877911
2026-01-28 20:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 589a0cad-6c48-5274-8459-47f121f719fa with identifier: 1877911
2026-01-28 20:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 589a0cad-6c48-5274-8459-47f121f719fa with scrape type 1
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/1.jpg not downloaded yet
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/2.jpg not downloaded yet
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4585010>
2026-01-28 20:03:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/2.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/3.jpg not downloaded yet
2026-01-28 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/4.jpg not downloaded yet
2026-01-28 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45baed0>
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/3.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418ded0>
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/5.jpg saved to cache
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/5.jpg not downloaded yet
2026-01-28 20:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/6.jpg not downloaded yet
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419c2d0>
2026-01-28 20:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/4.jpg saved to cache
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4256d50>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/6.jpg saved to cache
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b6790>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/7.jpg saved to cache
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/7.jpg not downloaded yet
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/8.jpg not downloaded yet
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c6d50>
2026-01-28 20:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd04b42c74fdd4c6ba6e6a04b656b64a7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/8.jpg saved to cache
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 23f3ecab-98b4-55c1-a547-45e0e521c523
2026-01-28 20:03:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 23f3ecab-98b4-55c1-a547-45e0e521c523, skipping ID generation
2026-01-28 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23f3ecab-98b4-55c1-a547-45e0e521c523 with scrape type 1
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 23f3ecab-98b4-55c1-a547-45e0e521c523 from tracking dictionaries
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 23f3ecab-98b4-55c1-a547-45e0e521c523 sending to next pipeline
2026-01-28 20:03:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 23f3ecab-98b4-55c1-a547-45e0e521c523, identifier: 1877910
2026-01-28 20:03:37 [ayvens.fr] INFO: Found listing with ID: 1877912
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877912%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [ayvens.fr] INFO: Scrape type for 1877912: 1
2026-01-28 20:03:37 [ayvens.fr] INFO: Extracting data for car ID: 1877912
2026-01-28 20:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9866eac1-edb7-568c-bae7-49e47332aa67 with identifier: 1877912
2026-01-28 20:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9866eac1-edb7-568c-bae7-49e47332aa67 with scrape type 1
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/1.jpg not downloaded yet
2026-01-28 20:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 23f3ecab-98b4-55c1-a547-45e0e521c523 with identifier: 1877910
2026-01-28 20:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 23f3ecab-98b4-55c1-a547-45e0e521c523 with identifier: 1877910
2026-01-28 20:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
2026-01-28 20:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 23f3ecab-98b4-55c1-a547-45e0e521c523 spider: ayvens.fr
2026-01-28 20:03:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 23f3ecab-98b4-55c1-a547-45e0e521c523 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'renault' containing 'renault' and model 'kangoo express' containing 'express'
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '23f3ecab-98b4-55c1-a547-45e0e521c523',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KANGOO EXPRESS',
'odometer': 50566,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400300,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261401,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262191,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_23f3ecab-98b4-55c1-a547-45e0e521c523/23f3ecab-98b4-55c1-a547-45e0e521c523_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 285814,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d04b42c74fdd4c6ba6e6a04b656b64a7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-01',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT KANGOO EXPRESS Kangoo Express Maxi 1.5 Blue dCi 95ch Grand '
'Volume Extra R-Link',
'transmission': 'manual',
'trim': 'Kangoo Express Maxi 1.5 Blue dCi 95ch Grand Volume Extra R-Link',
'vin': None,
'year': 2020}
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877910%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [ayvens.fr] INFO: Saving data for 1877910: {'created_time': 1769630617.654615, 'last_price_update_time': 1769630617.654627, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877910') HTTP/1.1" 204 0
2026-01-28 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/2.jpg not downloaded yet
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44f9fd0>
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/1.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bfb50>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/2.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/3.jpg not downloaded yet
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/4.jpg not downloaded yet
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff55450>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/4.jpg saved to cache
2026-01-28 20:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c5990>
2026-01-28 20:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/3.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/5.jpg not downloaded yet
2026-01-28 20:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a4550>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/5.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4076810>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/6.jpg saved to cache
2026-01-28 20:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4076e50>
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/7.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/6.jpg not downloaded yet
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/7.jpg not downloaded yet
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dcf50>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F926a08b02e3e488ca088338a6db12096%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/8.jpg saved to cache
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 589a0cad-6c48-5274-8459-47f121f719fa
2026-01-28 20:03:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 589a0cad-6c48-5274-8459-47f121f719fa, skipping ID generation
2026-01-28 20:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 589a0cad-6c48-5274-8459-47f121f719fa with scrape type 1
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 589a0cad-6c48-5274-8459-47f121f719fa from tracking dictionaries
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 589a0cad-6c48-5274-8459-47f121f719fa sending to next pipeline
2026-01-28 20:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 589a0cad-6c48-5274-8459-47f121f719fa, identifier: 1877911
2026-01-28 20:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 589a0cad-6c48-5274-8459-47f121f719fa with identifier: 1877911
2026-01-28 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 589a0cad-6c48-5274-8459-47f121f719fa with identifier: 1877911
2026-01-28 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 589a0cad-6c48-5274-8459-47f121f719fa spider: ayvens.fr
2026-01-28 20:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 589a0cad-6c48-5274-8459-47f121f719fa due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '589a0cad-6c48-5274-8459-47f121f719fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'SUZUKI',
'model': 'VITARA',
'odometer': 72834,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331800,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310456,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 276031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331038,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 286643,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_589a0cad-6c48-5274-8459-47f121f719fa/589a0cad-6c48-5274-8459-47f121f719fa_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/926a08b02e3e488ca088338a6db12096/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'SUZUKI VITARA Vitara 1.4 Boosterjet Hybrid 129ch Privilège',
'transmission': 'manual',
'trim': 'Vitara 1.4 Boosterjet Hybrid 129ch Privilège',
'vin': None,
'year': 2023}
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877911%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [ayvens.fr] INFO: Saving data for 1877911: {'created_time': 1769630620.706873, 'last_price_update_time': 1769630620.706886, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877911') HTTP/1.1" 204 0
2026-01-28 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/8.jpg not downloaded yet
2026-01-28 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:40 [ayvens.fr] INFO: Found listing with ID: 1877913
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877913%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [ayvens.fr] INFO: Scrape type for 1877913: 1
2026-01-28 20:03:40 [ayvens.fr] INFO: Extracting data for car ID: 1877913
2026-01-28 20:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 with identifier: 1877913
2026-01-28 20:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 with scrape type 1
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg not downloaded yet
2026-01-28 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg not downloaded yet
2026-01-28 20:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg not downloaded yet
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg not downloaded yet
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406e050>
2026-01-28 20:03:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/1.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff576d0>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/2.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg not downloaded yet
2026-01-28 20:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b7050>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/3.jpg saved to cache
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg not downloaded yet
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425d690>
2026-01-28 20:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/4.jpg saved to cache
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4587e50>
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/5.jpg saved to cache
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg not downloaded yet
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4161610>
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/6.jpg saved to cache
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg not downloaded yet
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:42 [ayvens.fr] INFO: Found listing with ID: 1877914
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877914%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [ayvens.fr] INFO: Scrape type for 1877914: 1
2026-01-28 20:03:43 [ayvens.fr] INFO: Extracting data for car ID: 1877914
2026-01-28 20:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d11f2b-ace4-5a7e-90a0-b108b7853133 with identifier: 1877914
2026-01-28 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d11f2b-ace4-5a7e-90a0-b108b7853133 with scrape type 1
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/1.jpg not downloaded yet
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40b2f90>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/8.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418c150>
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F6eeb85150c684ac58b256631e6d786e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/7.jpg saved to cache
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9866eac1-edb7-568c-bae7-49e47332aa67
2026-01-28 20:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9866eac1-edb7-568c-bae7-49e47332aa67, skipping ID generation
2026-01-28 20:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9866eac1-edb7-568c-bae7-49e47332aa67 with scrape type 1
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9866eac1-edb7-568c-bae7-49e47332aa67 from tracking dictionaries
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9866eac1-edb7-568c-bae7-49e47332aa67 sending to next pipeline
2026-01-28 20:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9866eac1-edb7-568c-bae7-49e47332aa67, identifier: 1877912
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/2.jpg not downloaded yet
2026-01-28 20:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9866eac1-edb7-568c-bae7-49e47332aa67 with identifier: 1877912
2026-01-28 20:03:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9866eac1-edb7-568c-bae7-49e47332aa67 with identifier: 1877912
2026-01-28 20:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9866eac1-edb7-568c-bae7-49e47332aa67 with identifier: 1877912 to the API
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'GRIS CLAIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '9866eac1-edb7-568c-bae7-49e47332aa67',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 41207,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396289,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 396289,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378708,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314933,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359619,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295086,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9866eac1-edb7-568c-bae7-49e47332aa67/9866eac1-edb7-568c-bae7-49e47332aa67_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291235,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/6eeb85150c684ac58b256631e6d786e7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Business -21N',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Business -21N',
'vin': None,
'year': 2022}
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877912%27 HTTP/1.1" 200 None
2026-01-28 20:03:44 [ayvens.fr] INFO: Saving data for 1877912: {'created_time': 1769630624.312606, 'last_price_update_time': 1769630624.312616, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877912') HTTP/1.1" 204 0
2026-01-28 20:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4281250>
2026-01-28 20:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429c9d0>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg saved to cache
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/3.jpg not downloaded yet
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40f4390>
2026-01-28 20:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2af10>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg saved to cache
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/4.jpg not downloaded yet
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/5.jpg not downloaded yet
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4454490>
2026-01-28 20:03:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/6.jpg not downloaded yet
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/7.jpg not downloaded yet
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406e5d0>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c3110>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg saved to cache
2026-01-28 20:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4141910>
2026-01-28 20:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F41d1b81d27274a67a67e432e3d3621a6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg saved to cache
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1
2026-01-28 20:03:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1, skipping ID generation
2026-01-28 20:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 with scrape type 1
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 from tracking dictionaries
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 sending to next pipeline
2026-01-28 20:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1, identifier: 1877913
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 with identifier: 1877913
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 with identifier: 1877913
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris kristall', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'crossland', 'trim': 'crossland 1.2 turbo 110ch elegance', 'title': 'opel crossland crossland 1.2 turbo 110ch elegance', 'price': 0, 'odometer': 19711, 'odometer_reading_unit': 'km', 'registration_date': '2023-11-20', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 131, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '40a91fbb-ffdf-58f4-869c-fcd5d82d03e1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 498442}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 498442}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 434031}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 299030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 348116}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 334774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 261310}], 'current_year_diff': 3, 'age_in_months': 26, 'make_model': 'opel crossland', 'sanitized_make': 'opel', 'odometer_in_km': 19711}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'gris kristall',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '40a91fbb-ffdf-58f4-869c-fcd5d82d03e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'opel',
'make_model': 'opel crossland',
'model': 'crossland',
'odometer': 19711,
'odometer_in_km': 19711,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-20',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland crossland 1.2 turbo 110ch elegance',
'transmission': 'manual',
'trim': 'crossland 1.2 turbo 110ch elegance',
'vin': None,
'year': 2023}
2026-01-28 20:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_FR failed for item: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 spider: ayvens.fr
2026-01-28 20:03:49 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 40a91fbb-ffdf-58f4-869c-fcd5d82d03e1 due to rule: puretech_for_fr.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris kristall', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'opel', 'model': 'crossland', 'trim': 'crossland 1.2 turbo 110ch elegance', 'title': 'opel crossland crossland 1.2 turbo 110ch elegance', 'price': 0, 'odometer': 19711, 'odometer_reading_unit': 'km', 'registration_date': '2023-11-20', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 131, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '40a91fbb-ffdf-58f4-869c-fcd5d82d03e1', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 498442}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 498442}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 434031}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 299030}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 348116}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 334774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301628}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 261310}], 'current_year_diff': 3, 'age_in_months': 26, 'make_model': 'opel crossland', 'sanitized_make': 'opel', 'odometer_in_km': 19711}
Failed validating None in schema:
False
On instance:
{'age_in_months': 26,
'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'gris kristall',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '40a91fbb-ffdf-58f4-869c-fcd5d82d03e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'opel',
'make_model': 'opel crossland',
'model': 'crossland',
'odometer': 19711,
'odometer_in_km': 19711,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-20',
'sanitized_make': 'opel',
'seats_number': 5,
'seller_name': None,
'title': 'opel crossland crossland 1.2 turbo 110ch elegance',
'transmission': 'manual',
'trim': 'crossland 1.2 turbo 110ch elegance',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'GRIS KRISTALL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '40a91fbb-ffdf-58f4-869c-fcd5d82d03e1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'CROSSLAND',
'odometer': 19711,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 498442,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434031,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301628,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40a91fbb-ffdf-58f4-869c-fcd5d82d03e1/40a91fbb-ffdf-58f4-869c-fcd5d82d03e1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 261310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/41d1b81d27274a67a67e432e3d3621a6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-20',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL CROSSLAND Crossland 1.2 Turbo 110ch Elegance',
'transmission': 'manual',
'trim': 'Crossland 1.2 Turbo 110ch Elegance',
'vin': None,
'year': 2023}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877913%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.fr] INFO: Saving data for 1877913: {'created_time': 1769630629.72304, 'last_price_update_time': 1769630629.723054, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877913') HTTP/1.1" 204 0
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/8.jpg not downloaded yet
2026-01-28 20:03:49 [ayvens.fr] INFO: Found listing with ID: 1877915
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877915%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [ayvens.fr] INFO: Scrape type for 1877915: 1
2026-01-28 20:03:49 [ayvens.fr] INFO: Extracting data for car ID: 1877915
2026-01-28 20:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 with identifier: 1877915
2026-01-28 20:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 with scrape type 1
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/1.jpg not downloaded yet
2026-01-28 20:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4320f50>
2026-01-28 20:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/1.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/2.jpg not downloaded yet
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/3.jpg not downloaded yet
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45a87d0>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/2.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/4.jpg not downloaded yet
2026-01-28 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/5.jpg not downloaded yet
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43078d0>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/3.jpg saved to cache
2026-01-28 20:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4162690>
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/4.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bc7d0>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/5.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/6.jpg not downloaded yet
2026-01-28 20:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/7.jpg not downloaded yet
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4454490>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/6.jpg saved to cache
2026-01-28 20:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b8d90>
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/7.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/8.jpg not downloaded yet
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:52 [ayvens.fr] INFO: Found listing with ID: 1877916
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877916%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [ayvens.fr] INFO: Scrape type for 1877916: 1
2026-01-28 20:03:52 [ayvens.fr] INFO: Extracting data for car ID: 1877916
2026-01-28 20:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22b5680e-e41b-550c-921e-f3ea5298f3d5 with identifier: 1877916
2026-01-28 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b5680e-e41b-550c-921e-f3ea5298f3d5 with scrape type 1
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/1.jpg not downloaded yet
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4163ad0>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff0b348455b534126bd9bccf1654df271%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/8.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a7d11f2b-ace4-5a7e-90a0-b108b7853133
2026-01-28 20:03:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a7d11f2b-ace4-5a7e-90a0-b108b7853133, skipping ID generation
2026-01-28 20:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d11f2b-ace4-5a7e-90a0-b108b7853133 with scrape type 1
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a7d11f2b-ace4-5a7e-90a0-b108b7853133 from tracking dictionaries
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a7d11f2b-ace4-5a7e-90a0-b108b7853133 sending to next pipeline
2026-01-28 20:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a7d11f2b-ace4-5a7e-90a0-b108b7853133, identifier: 1877914
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b5850>
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/1.jpg saved to cache
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/2.jpg not downloaded yet
2026-01-28 20:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a7d11f2b-ace4-5a7e-90a0-b108b7853133 with identifier: 1877914
2026-01-28 20:03:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a7d11f2b-ace4-5a7e-90a0-b108b7853133 with identifier: 1877914
2026-01-28 20:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a7d11f2b-ace4-5a7e-90a0-b108b7853133 with identifier: 1877914 to the API
2026-01-28 20:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'a7d11f2b-ace4-5a7e-90a0-b108b7853133',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 124868,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401695,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311446,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267314,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a7d11f2b-ace4-5a7e-90a0-b108b7853133/a7d11f2b-ace4-5a7e-90a0-b108b7853133_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257891,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f0b348455b534126bd9bccf1654df271/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-11',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.6 E-Tech 145ch Business',
'transmission': 'automatic',
'trim': 'Arkana 1.6 E-Tech 145ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877914%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [ayvens.fr] INFO: Saving data for 1877914: {'created_time': 1769630634.27668, 'last_price_update_time': 1769630634.276695, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877914') HTTP/1.1" 204 0
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/3.jpg not downloaded yet
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c429f910>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/2.jpg saved to cache
2026-01-28 20:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41db290>
2026-01-28 20:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/3.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/4.jpg not downloaded yet
2026-01-28 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/5.jpg not downloaded yet
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4305550>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/5.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43361d0>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/4.jpg saved to cache
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/6.jpg not downloaded yet
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff28fd0>
2026-01-28 20:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/6.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44fa950>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/7.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bfdd0>
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F17415cbc80894fd2a402efb16eca776e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/8.jpg saved to cache
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1
2026-01-28 20:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1, skipping ID generation
2026-01-28 20:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 with scrape type 1
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 from tracking dictionaries
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 sending to next pipeline
2026-01-28 20:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1, identifier: 1877915
2026-01-28 20:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/7.jpg not downloaded yet
2026-01-28 20:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 with identifier: 1877915
2026-01-28 20:03:56 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 with identifier: 1877915
2026-01-28 20:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1 with identifier: 1877915 to the API
2026-01-28 20:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 103,
'color': 'BLANC PUR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 106960,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 368207,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319384,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 265307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365833,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1/b77cf9f5-94d4-5ac8-a0c6-1301d348b2d1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/17415cbc80894fd2a402efb16eca776e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-01',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA COROLLA Corolla 122h Dynamic Business + Programme "Beyond '
'Zero Academy"',
'transmission': 'automatic',
'trim': 'Corolla 122h Dynamic Business + Programme "Beyond Zero Academy"',
'vin': None,
'year': 2022}
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877915%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [ayvens.fr] INFO: Saving data for 1877915: {'created_time': 1769630637.282266, 'last_price_update_time': 1769630637.282276, 'auction_closing_time': 1769695200.0}
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877915') HTTP/1.1" 204 0
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/8.jpg not downloaded yet
2026-01-28 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4534290>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/1.jpg saved to cache
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:57 [ayvens.fr] INFO: Found listing with ID: 1877917
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877917%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [ayvens.fr] INFO: Scrape type for 1877917: 1
2026-01-28 20:03:57 [ayvens.fr] INFO: Extracting data for car ID: 1877917
2026-01-28 20:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6228b018-c0d8-52b2-b7f8-3cde7189233c with identifier: 1877917
2026-01-28 20:03:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6228b018-c0d8-52b2-b7f8-3cde7189233c with scrape type 1
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg not downloaded yet
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg not downloaded yet
2026-01-28 20:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4084b50>
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/2.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e15d0>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/3.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg not downloaded yet
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg not downloaded yet
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e75d0>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/4.jpg saved to cache
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg not downloaded yet
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg not downloaded yet
2026-01-28 20:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c6150>
2026-01-28 20:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/6.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4087fd0>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/5.jpg saved to cache
2026-01-28 20:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4076290>
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/7.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg not downloaded yet
2026-01-28 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg not downloaded yet
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4306550>
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd00538bba85f44609fe0d30271d688ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/8.jpg saved to cache
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 22b5680e-e41b-550c-921e-f3ea5298f3d5
2026-01-28 20:04:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 22b5680e-e41b-550c-921e-f3ea5298f3d5, skipping ID generation
2026-01-28 20:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22b5680e-e41b-550c-921e-f3ea5298f3d5 with scrape type 1
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 22b5680e-e41b-550c-921e-f3ea5298f3d5 from tracking dictionaries
2026-01-28 20:04:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 22b5680e-e41b-550c-921e-f3ea5298f3d5 sending to next pipeline
2026-01-28 20:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 22b5680e-e41b-550c-921e-f3ea5298f3d5, identifier: 1877916
2026-01-28 20:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 22b5680e-e41b-550c-921e-f3ea5298f3d5 with identifier: 1877916
2026-01-28 20:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 22b5680e-e41b-550c-921e-f3ea5298f3d5 with identifier: 1877916
2026-01-28 20:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
2026-01-28 20:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 22b5680e-e41b-550c-921e-f3ea5298f3d5 spider: ayvens.fr
2026-01-28 20:04:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 22b5680e-e41b-550c-921e-f3ea5298f3d5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'expert' containing 'expert'
{'auction_title': '',
'c_o_2_emission_value': 128,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '22b5680e-e41b-550c-921e-f3ea5298f3d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'EXPERT',
'odometer': 112114,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352100,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292003,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333996,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22b5680e-e41b-550c-921e-f3ea5298f3d5/22b5680e-e41b-550c-921e-f3ea5298f3d5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436591,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d00538bba85f44609fe0d30271d688ab/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-14',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT EXPERT Expert Fg Standard 1.5 BlueHDi 120ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Expert Fg Standard 1.5 BlueHDi 120ch S&S Asphalt',
'vin': None,
'year': 2019}
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877916%27 HTTP/1.1" 200 None
2026-01-28 20:04:00 [ayvens.fr] INFO: Saving data for 1877916: {'created_time': 1769630640.976928, 'last_price_update_time': 1769630640.976941, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877916') HTTP/1.1" 204 0
2026-01-28 20:04:01 [ayvens.fr] INFO: Found listing with ID: 1877918
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877918%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [ayvens.fr] INFO: Scrape type for 1877918: 1
2026-01-28 20:04:01 [ayvens.fr] INFO: Extracting data for car ID: 1877918
2026-01-28 20:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47279492-bb2b-569c-8567-7be2d2a2d9b7 with identifier: 1877918
2026-01-28 20:04:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47279492-bb2b-569c-8567-7be2d2a2d9b7 with scrape type 1
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/1.jpg not downloaded yet
2026-01-28 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c2a10>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/2.jpg not downloaded yet
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c39d0>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg saved to cache
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/3.jpg not downloaded yet
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4454f10>
2026-01-28 20:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/4.jpg not downloaded yet
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff16a50>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4518590>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg saved to cache
2026-01-28 20:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4584790>
2026-01-28 20:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/5.jpg not downloaded yet
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/6.jpg not downloaded yet
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4162690>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/7.jpg not downloaded yet
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/8.jpg not downloaded yet
2026-01-28 20:04:03 [ayvens.fr] INFO: Found listing with ID: 1877919
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877919%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [ayvens.fr] INFO: Scrape type for 1877919: 1
2026-01-28 20:04:03 [ayvens.fr] INFO: Extracting data for car ID: 1877919
2026-01-28 20:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aab26957-9da4-5d4f-95d2-c51993d2dfd5 with identifier: 1877919
2026-01-28 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aab26957-9da4-5d4f-95d2-c51993d2dfd5 with scrape type 1
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/1.jpg not downloaded yet
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/2.jpg not downloaded yet
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff7aa10>
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252Fb16eda9e41f1437f88980883e27b4da9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg saved to cache
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6228b018-c0d8-52b2-b7f8-3cde7189233c
2026-01-28 20:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6228b018-c0d8-52b2-b7f8-3cde7189233c, skipping ID generation
2026-01-28 20:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6228b018-c0d8-52b2-b7f8-3cde7189233c with scrape type 1
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6228b018-c0d8-52b2-b7f8-3cde7189233c from tracking dictionaries
2026-01-28 20:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6228b018-c0d8-52b2-b7f8-3cde7189233c sending to next pipeline
2026-01-28 20:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6228b018-c0d8-52b2-b7f8-3cde7189233c, identifier: 1877917
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c5f20f90>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/1.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff28290>
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/2.jpg saved to cache
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/3.jpg not downloaded yet
2026-01-28 20:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6228b018-c0d8-52b2-b7f8-3cde7189233c with identifier: 1877917
2026-01-28 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6228b018-c0d8-52b2-b7f8-3cde7189233c with identifier: 1877917
2026-01-28 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 100ch s&s active business', 'title': 'peugeot 208 208 1.2 puretech 100ch s&s active business', 'price': 0, 'odometer': 64006, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-28', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 123, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6228b018-c0d8-52b2-b7f8-3cde7189233c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 435727}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 435727}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 398730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 295941}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 260966}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 281218}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 514095}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 64006}
Failed validating None in schema:
False
On instance:
{'age_in_months': 61,
'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '6228b018-c0d8-52b2-b7f8-3cde7189233c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 64006,
'odometer_in_km': 64006,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 100ch s&s active business',
'transmission': 'manual',
'trim': '208 1.2 puretech 100ch s&s active business',
'vin': None,
'year': 2020}
2026-01-28 20:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6228b018-c0d8-52b2-b7f8-3cde7189233c spider: ayvens.fr
2026-01-28 20:04:04 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6228b018-c0d8-52b2-b7f8-3cde7189233c due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 100ch s&s active business', 'title': 'peugeot 208 208 1.2 puretech 100ch s&s active business', 'price': 0, 'odometer': 64006, 'odometer_reading_unit': 'km', 'registration_date': '2020-12-28', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 123, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '6228b018-c0d8-52b2-b7f8-3cde7189233c', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 435727}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 435727}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 398730}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 323064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 295941}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 260966}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 281218}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 514095}], 'current_year_diff': 6, 'age_in_months': 61, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 64006}
Failed validating None in schema:
False
On instance:
{'age_in_months': 61,
'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '6228b018-c0d8-52b2-b7f8-3cde7189233c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 64006,
'odometer_in_km': 64006,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-28',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 100ch s&s active business',
'transmission': 'manual',
'trim': '208 1.2 puretech 100ch s&s active business',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '6228b018-c0d8-52b2-b7f8-3cde7189233c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 64006,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435727,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295941,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260966,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 281218,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6228b018-c0d8-52b2-b7f8-3cde7189233c/6228b018-c0d8-52b2-b7f8-3cde7189233c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 514095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/b16eda9e41f1437f88980883e27b4da9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-28',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 100ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.2 PureTech 100ch S&S Active Business',
'vin': None,
'year': 2020}
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877917%27 HTTP/1.1" 200 None
2026-01-28 20:04:04 [ayvens.fr] INFO: Saving data for 1877917: {'created_time': 1769630644.965263, 'last_price_update_time': 1769630644.965278, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877917') HTTP/1.1" 204 0
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/4.jpg not downloaded yet
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4282a10>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/3.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44f8390>
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/4.jpg saved to cache
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/5.jpg not downloaded yet
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/6.jpg not downloaded yet
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4329dd0>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/7.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4282850>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/5.jpg saved to cache
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/7.jpg not downloaded yet
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/8.jpg not downloaded yet
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff15810>
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/6.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b9e50>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F2c8926ef3a384a4e95ad2c4f53957bf6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/8.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 47279492-bb2b-569c-8567-7be2d2a2d9b7
2026-01-28 20:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47279492-bb2b-569c-8567-7be2d2a2d9b7, skipping ID generation
2026-01-28 20:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47279492-bb2b-569c-8567-7be2d2a2d9b7 with scrape type 1
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 47279492-bb2b-569c-8567-7be2d2a2d9b7 from tracking dictionaries
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 47279492-bb2b-569c-8567-7be2d2a2d9b7 sending to next pipeline
2026-01-28 20:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 47279492-bb2b-569c-8567-7be2d2a2d9b7, identifier: 1877918
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c62179d0>
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/1.jpg saved to cache
2026-01-28 20:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 47279492-bb2b-569c-8567-7be2d2a2d9b7 with identifier: 1877918
2026-01-28 20:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 47279492-bb2b-569c-8567-7be2d2a2d9b7 with identifier: 1877918
2026-01-28 20:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 47279492-bb2b-569c-8567-7be2d2a2d9b7 with identifier: 1877918 to the API
2026-01-28 20:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': 'NOIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '47279492-bb2b-569c-8567-7be2d2a2d9b7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 110978,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 418310,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 245740,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47279492-bb2b-569c-8567-7be2d2a2d9b7/47279492-bb2b-569c-8567-7be2d2a2d9b7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/2c8926ef3a384a4e95ad2c4f53957bf6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2022}
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877918%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [ayvens.fr] INFO: Saving data for 1877918: {'created_time': 1769630648.22598, 'last_price_update_time': 1769630648.225993, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877918') HTTP/1.1" 204 0
2026-01-28 20:04:08 [ayvens.fr] INFO: Found listing with ID: 1877920
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877920%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [ayvens.fr] INFO: Scrape type for 1877920: 1
2026-01-28 20:04:08 [ayvens.fr] INFO: Extracting data for car ID: 1877920
2026-01-28 20:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 with identifier: 1877920
2026-01-28 20:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 with scrape type 1
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/1.jpg not downloaded yet
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4506dd0>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/2.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/2.jpg not downloaded yet
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/3.jpg not downloaded yet
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40f78d0>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/3.jpg saved to cache
2026-01-28 20:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425f790>
2026-01-28 20:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/4.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/4.jpg not downloaded yet
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4587ad0>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/5.jpg saved to cache
2026-01-28 20:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4154990>
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/6.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/5.jpg not downloaded yet
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/6.jpg not downloaded yet
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/7.jpg not downloaded yet
2026-01-28 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/8.jpg not downloaded yet
2026-01-28 20:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:10 [ayvens.fr] INFO: Found listing with ID: 1877921
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877921%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [ayvens.fr] INFO: Scrape type for 1877921: 1
2026-01-28 20:04:10 [ayvens.fr] INFO: Extracting data for car ID: 1877921
2026-01-28 20:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6be46eb8-4d9b-536b-b795-eaf94faf3091 with identifier: 1877921
2026-01-28 20:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be46eb8-4d9b-536b-b795-eaf94faf3091 with scrape type 1
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/1.jpg not downloaded yet
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/2.jpg not downloaded yet
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4048650>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/7.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/3.jpg not downloaded yet
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/4.jpg not downloaded yet
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/5.jpg not downloaded yet
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41da350>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/1.jpg saved to cache
2026-01-28 20:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4141490>
2026-01-28 20:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fey-%252Fb2a1a3af8b7f483ea454f505093de7ab%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/8.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aab26957-9da4-5d4f-95d2-c51993d2dfd5
2026-01-28 20:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aab26957-9da4-5d4f-95d2-c51993d2dfd5, skipping ID generation
2026-01-28 20:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aab26957-9da4-5d4f-95d2-c51993d2dfd5 with scrape type 1
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aab26957-9da4-5d4f-95d2-c51993d2dfd5 from tracking dictionaries
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aab26957-9da4-5d4f-95d2-c51993d2dfd5 sending to next pipeline
2026-01-28 20:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aab26957-9da4-5d4f-95d2-c51993d2dfd5, identifier: 1877919
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c455f390>
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/2.jpg saved to cache
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aab26957-9da4-5d4f-95d2-c51993d2dfd5 with identifier: 1877919
2026-01-28 20:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aab26957-9da4-5d4f-95d2-c51993d2dfd5 with identifier: 1877919
2026-01-28 20:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: aab26957-9da4-5d4f-95d2-c51993d2dfd5 spider: ayvens.fr
2026-01-28 20:04:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: aab26957-9da4-5d4f-95d2-c51993d2dfd5 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
'c_o_2_emission_value': 139,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'aab26957-9da4-5d4f-95d2-c51993d2dfd5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 69592,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257260,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366876,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303133,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328194,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aab26957-9da4-5d4f-95d2-c51993d2dfd5/aab26957-9da4-5d4f-95d2-c51993d2dfd5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 486355,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ey-/b2a1a3af8b7f483ea454f505093de7ab/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-06-12',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg XS 1.6 BlueHDi 95ch Club S&S ETG6',
'transmission': 'automatic',
'trim': 'Jumpy Fg XS 1.6 BlueHDi 95ch Club S&S ETG6',
'vin': None,
'year': 2018}
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877919%27 HTTP/1.1" 200 None
2026-01-28 20:04:11 [ayvens.fr] INFO: Saving data for 1877919: {'created_time': 1769630651.927432, 'last_price_update_time': 1769630651.927448, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877919') HTTP/1.1" 204 0
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/6.jpg not downloaded yet
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/7.jpg not downloaded yet
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e6550>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/6.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40f5e50>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/5.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435be90>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/7.jpg saved to cache
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/8.jpg not downloaded yet
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:12 [ayvens.fr] INFO: Found listing with ID: 1877922
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877922%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [ayvens.fr] INFO: Scrape type for 1877922: 1
2026-01-28 20:04:12 [ayvens.fr] INFO: Extracting data for car ID: 1877922
2026-01-28 20:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 with identifier: 1877922
2026-01-28 20:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 with scrape type 1
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/1.jpg not downloaded yet
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c5910>
2026-01-28 20:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/3.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c421bbd0>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/4.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435a5d0>
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fa233043caf0d41aea376f87e0e6b8b51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/8.jpg saved to cache
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61
2026-01-28 20:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61, skipping ID generation
2026-01-28 20:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 with scrape type 1
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 from tracking dictionaries
2026-01-28 20:04:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 sending to next pipeline
2026-01-28 20:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61, identifier: 1877920
2026-01-28 20:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 with identifier: 1877920
2026-01-28 20:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 with identifier: 1877920
2026-01-28 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 spider: ayvens.fr
2026-01-28 20:04:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 2b631f3d-f2e9-5b3d-b86d-1bceb8790b61 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 94,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '2b631f3d-f2e9-5b3d-b86d-1bceb8790b61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 102225,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 471253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 482527,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355361,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 342661,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365767,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268772,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b631f3d-f2e9-5b3d-b86d-1bceb8790b61/2b631f3d-f2e9-5b3d-b86d-1bceb8790b61_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374039,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/a233043caf0d41aea376f87e0e6b8b51/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-10-24',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '308 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2019}
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877920%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [ayvens.fr] INFO: Saving data for 1877920: {'created_time': 1769630654.201251, 'last_price_update_time': 1769630654.201266, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877920') HTTP/1.1" 204 0
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/2.jpg not downloaded yet
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c470cf50>
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/1.jpg saved to cache
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407c110>
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/2.jpg saved to cache
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/3.jpg not downloaded yet
2026-01-28 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/4.jpg not downloaded yet
2026-01-28 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/5.jpg not downloaded yet
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/6.jpg not downloaded yet
2026-01-28 20:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/7.jpg not downloaded yet
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4087dd0>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/4.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4359690>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/3.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c470f250>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/5.jpg saved to cache
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/8.jpg not downloaded yet
2026-01-28 20:04:15 [ayvens.fr] INFO: Found listing with ID: 1877923
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877923%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [ayvens.fr] INFO: Scrape type for 1877923: 1
2026-01-28 20:04:15 [ayvens.fr] INFO: Extracting data for car ID: 1877923
2026-01-28 20:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 772cedb5-240f-52ab-9072-f261f31c5315 with identifier: 1877923
2026-01-28 20:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772cedb5-240f-52ab-9072-f261f31c5315 with scrape type 1
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/1.jpg not downloaded yet
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40c98d0>
2026-01-28 20:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/7.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4306210>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/6.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425f690>
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F65def2023a4d4f1da5d230f126498219%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/8.jpg saved to cache
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6be46eb8-4d9b-536b-b795-eaf94faf3091
2026-01-28 20:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6be46eb8-4d9b-536b-b795-eaf94faf3091, skipping ID generation
2026-01-28 20:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6be46eb8-4d9b-536b-b795-eaf94faf3091 with scrape type 1
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6be46eb8-4d9b-536b-b795-eaf94faf3091 from tracking dictionaries
2026-01-28 20:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6be46eb8-4d9b-536b-b795-eaf94faf3091 sending to next pipeline
2026-01-28 20:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6be46eb8-4d9b-536b-b795-eaf94faf3091, identifier: 1877921
2026-01-28 20:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6be46eb8-4d9b-536b-b795-eaf94faf3091 with identifier: 1877921
2026-01-28 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6be46eb8-4d9b-536b-b795-eaf94faf3091 with identifier: 1877921
2026-01-28 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 6be46eb8-4d9b-536b-b795-eaf94faf3091 spider: ayvens.fr
2026-01-28 20:04:17 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6be46eb8-4d9b-536b-b795-eaf94faf3091 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '6be46eb8-4d9b-536b-b795-eaf94faf3091',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 87623,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440411,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372238,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379439,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387607,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344648,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260861,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6be46eb8-4d9b-536b-b795-eaf94faf3091/6be46eb8-4d9b-536b-b795-eaf94faf3091_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478690,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/65def2023a4d4f1da5d230f126498219/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-20',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT MEGANE Megane Sté 1.5 Blue dCi 115ch Air Nav',
'transmission': 'manual',
'trim': 'Megane Sté 1.5 Blue dCi 115ch Air Nav',
'vin': None,
'year': 2021}
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877921%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [ayvens.fr] INFO: Saving data for 1877921: {'created_time': 1769630657.092251, 'last_price_update_time': 1769630657.092265, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877921') HTTP/1.1" 204 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/2.jpg not downloaded yet
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/3.jpg not downloaded yet
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/4.jpg not downloaded yet
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/5.jpg not downloaded yet
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/6.jpg not downloaded yet
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/7.jpg not downloaded yet
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4575410>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/3.jpg saved to cache
2026-01-28 20:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43172d0>
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/2.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45754d0>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/4.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458a7d0>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/5.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/8.jpg not downloaded yet
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff52610>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/7.jpg saved to cache
2026-01-28 20:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435a590>
2026-01-28 20:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/1.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41438d0>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/6.jpg saved to cache
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:19 [ayvens.fr] INFO: Found listing with ID: 1877924
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877924%27 HTTP/1.1" 200 None
2026-01-28 20:04:19 [ayvens.fr] INFO: Scrape type for 1877924: 1
2026-01-28 20:04:19 [ayvens.fr] INFO: Extracting data for car ID: 1877924
2026-01-28 20:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4ad7015-f83f-562b-bf3d-d7f96a5eb282 with identifier: 1877924
2026-01-28 20:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282 with scrape type 1
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/1.jpg not downloaded yet
2026-01-28 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/2.jpg not downloaded yet
2026-01-28 20:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416c790>
2026-01-28 20:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F3562b7b31c4a4854b31ef52accafe4ba%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/8.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2
2026-01-28 20:04:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2, skipping ID generation
2026-01-28 20:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 with scrape type 1
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 from tracking dictionaries
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 sending to next pipeline
2026-01-28 20:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2, identifier: 1877922
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/3.jpg not downloaded yet
2026-01-28 20:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 with identifier: 1877922
2026-01-28 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 with identifier: 1877922
2026-01-28 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 137579 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
137579
2026-01-28 20:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 spider: ayvens.fr
2026-01-28 20:04:20 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 388ce4d2-cd05-5e11-81cc-6f24d5ec85d2 due to rule: high_mileage_for_make.json, error: 137579 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
137579
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '388ce4d2-cd05-5e11-81cc-6f24d5ec85d2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 137579,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439907,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388722,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327423,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323633,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 256858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_388ce4d2-cd05-5e11-81cc-6f24d5ec85d2/388ce4d2-cd05-5e11-81cc-6f24d5ec85d2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 479567,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/3562b7b31c4a4854b31ef52accafe4ba/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-10',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Allure Pack EAT8',
'vin': None,
'year': 2022}
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877922%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [ayvens.fr] INFO: Saving data for 1877922: {'created_time': 1769630660.483374, 'last_price_update_time': 1769630660.483385, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877922') HTTP/1.1" 204 0
2026-01-28 20:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/4.jpg not downloaded yet
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4472bd0>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/1.jpg saved to cache
2026-01-28 20:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c455dd50>
2026-01-28 20:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/2.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4472f50>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/3.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f8690>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/5.jpg saved to cache
2026-01-28 20:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a6450>
2026-01-28 20:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/4.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/5.jpg not downloaded yet
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4280090>
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/6.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/6.jpg not downloaded yet
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/7.jpg not downloaded yet
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/8.jpg not downloaded yet
2026-01-28 20:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:22 [ayvens.fr] INFO: Found listing with ID: 1877925
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877925%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [ayvens.fr] INFO: Scrape type for 1877925: 1
2026-01-28 20:04:22 [ayvens.fr] INFO: Extracting data for car ID: 1877925
2026-01-28 20:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4080479-a9dc-5aba-9cb4-0697f6667c99 with identifier: 1877925
2026-01-28 20:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4080479-a9dc-5aba-9cb4-0697f6667c99 with scrape type 1
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/1.jpg not downloaded yet
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/2.jpg not downloaded yet
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4142f10>
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/7.jpg saved to cache
2026-01-28 20:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1eff50>
2026-01-28 20:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F3ee1f276a6664707a5515d2badf44f24%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/8.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 772cedb5-240f-52ab-9072-f261f31c5315
2026-01-28 20:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 772cedb5-240f-52ab-9072-f261f31c5315, skipping ID generation
2026-01-28 20:04:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 772cedb5-240f-52ab-9072-f261f31c5315 with scrape type 1
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 772cedb5-240f-52ab-9072-f261f31c5315 from tracking dictionaries
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 772cedb5-240f-52ab-9072-f261f31c5315 sending to next pipeline
2026-01-28 20:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 772cedb5-240f-52ab-9072-f261f31c5315, identifier: 1877923
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4283d10>
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/1.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a6fd0>
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/2.jpg saved to cache
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/3.jpg not downloaded yet
2026-01-28 20:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 772cedb5-240f-52ab-9072-f261f31c5315 with identifier: 1877923
2026-01-28 20:04:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 772cedb5-240f-52ab-9072-f261f31c5315 with identifier: 1877923
2026-01-28 20:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 772cedb5-240f-52ab-9072-f261f31c5315 with identifier: 1877923 to the API
2026-01-28 20:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 131,
'color': 'MINERALWEISS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '772cedb5-240f-52ab-9072-f261f31c5315',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 1',
'odometer': 92257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341995,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300306,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_772cedb5-240f-52ab-9072-f261f31c5315/772cedb5-240f-52ab-9072-f261f31c5315_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/3ee1f276a6664707a5515d2badf44f24/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 1 Serie 1 118iA 136ch Business Design DKG7',
'transmission': 'automatic',
'trim': 'Serie 1 118iA 136ch Business Design DKG7',
'vin': None,
'year': 2021}
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877923%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [ayvens.fr] INFO: Saving data for 1877923: {'created_time': 1769630664.22536, 'last_price_update_time': 1769630664.22538, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877923') HTTP/1.1" 204 0
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c612e090>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/3.jpg saved to cache
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/4.jpg not downloaded yet
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaecb10>
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/4.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/5.jpg not downloaded yet
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/6.jpg not downloaded yet
2026-01-28 20:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/7.jpg not downloaded yet
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4155d90>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/5.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c405aed0>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/7.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4473810>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/6.jpg saved to cache
2026-01-28 20:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4487ed0>
2026-01-28 20:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F1b93ec41504547878a1433ba34d056ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/8.jpg saved to cache
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282
2026-01-28 20:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4ad7015-f83f-562b-bf3d-d7f96a5eb282, skipping ID generation
2026-01-28 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282 with scrape type 1
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a4ad7015-f83f-562b-bf3d-d7f96a5eb282 from tracking dictionaries
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4ad7015-f83f-562b-bf3d-d7f96a5eb282 sending to next pipeline
2026-01-28 20:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a4ad7015-f83f-562b-bf3d-d7f96a5eb282, identifier: 1877924
2026-01-28 20:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/8.jpg not downloaded yet
2026-01-28 20:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a4ad7015-f83f-562b-bf3d-d7f96a5eb282 with identifier: 1877924
2026-01-28 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a4ad7015-f83f-562b-bf3d-d7f96a5eb282 with identifier: 1877924
2026-01-28 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: a4ad7015-f83f-562b-bf3d-d7f96a5eb282 spider: ayvens.fr
2026-01-28 20:04:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: a4ad7015-f83f-562b-bf3d-d7f96a5eb282 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'a4ad7015-f83f-562b-bf3d-d7f96a5eb282',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 91042,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367063,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356247,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280462,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291458,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4ad7015-f83f-562b-bf3d-d7f96a5eb282/a4ad7015-f83f-562b-bf3d-d7f96a5eb282_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391510,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/1b93ec41504547878a1433ba34d056ea/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2021}
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877924%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [ayvens.fr] INFO: Saving data for 1877924: {'created_time': 1769630666.702225, 'last_price_update_time': 1769630666.702463, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877924') HTTP/1.1" 204 0
2026-01-28 20:04:26 [ayvens.fr] INFO: Found listing with ID: 1877926
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877926%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [ayvens.fr] INFO: Scrape type for 1877926: 1
2026-01-28 20:04:26 [ayvens.fr] INFO: Extracting data for car ID: 1877926
2026-01-28 20:04:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aee8ae6c-1193-5878-9bea-1bc1e19cc0cc with identifier: 1877926
2026-01-28 20:04:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc with scrape type 1
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/1.jpg not downloaded yet
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b7e90>
2026-01-28 20:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/1.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42978d0>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/2.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/2.jpg not downloaded yet
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/3.jpg not downloaded yet
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/4.jpg not downloaded yet
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/5.jpg not downloaded yet
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/6.jpg not downloaded yet
2026-01-28 20:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/7.jpg not downloaded yet
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b4ad0>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/3.jpg saved to cache
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/8.jpg not downloaded yet
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452b410>
2026-01-28 20:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/4.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a6450>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/5.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:28 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at -1 pages/min), scraped 21 items (at 5 items/min)
2026-01-28 20:04:28 [ayvens.fr] INFO: Found listing with ID: 1877927
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877927%27 HTTP/1.1" 200 None
2026-01-28 20:04:28 [ayvens.fr] INFO: Scrape type for 1877927: 1
2026-01-28 20:04:28 [ayvens.fr] INFO: Extracting data for car ID: 1877927
2026-01-28 20:04:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5601c7f2-5824-598b-97b9-fbf5fc3b9234 with identifier: 1877927
2026-01-28 20:04:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234 with scrape type 1
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/1.jpg not downloaded yet
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b8710>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/6.jpg saved to cache
2026-01-28 20:04:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b8a90>
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/7.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4577590>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F54864a39755f4727846f8c00d8182333%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/8.jpg saved to cache
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c4080479-a9dc-5aba-9cb4-0697f6667c99
2026-01-28 20:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c4080479-a9dc-5aba-9cb4-0697f6667c99, skipping ID generation
2026-01-28 20:04:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4080479-a9dc-5aba-9cb4-0697f6667c99 with scrape type 1
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item c4080479-a9dc-5aba-9cb4-0697f6667c99 from tracking dictionaries
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c4080479-a9dc-5aba-9cb4-0697f6667c99 sending to next pipeline
2026-01-28 20:04:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: c4080479-a9dc-5aba-9cb4-0697f6667c99, identifier: 1877925
2026-01-28 20:04:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: c4080479-a9dc-5aba-9cb4-0697f6667c99 with identifier: 1877925
2026-01-28 20:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: c4080479-a9dc-5aba-9cb4-0697f6667c99 with identifier: 1877925
2026-01-28 20:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: c4080479-a9dc-5aba-9cb4-0697f6667c99 spider: ayvens.fr
2026-01-28 20:04:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: c4080479-a9dc-5aba-9cb4-0697f6667c99 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'c4080479-a9dc-5aba-9cb4-0697f6667c99',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 55943,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367330,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 451982,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480930,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349471,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301702,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c4080479-a9dc-5aba-9cb4-0697f6667c99/c4080479-a9dc-5aba-9cb4-0697f6667c99_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/54864a39755f4727846f8c00d8182333/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-02',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877925%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [ayvens.fr] INFO: Saving data for 1877925: {'created_time': 1769630669.655605, 'last_price_update_time': 1769630669.655614, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877925') HTTP/1.1" 204 0
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/2.jpg not downloaded yet
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/3.jpg not downloaded yet
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/4.jpg not downloaded yet
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/5.jpg not downloaded yet
2026-01-28 20:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/6.jpg not downloaded yet
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/7.jpg not downloaded yet
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/8.jpg not downloaded yet
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff37cd0>
2026-01-28 20:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/4.jpg saved to cache
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414f790>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/2.jpg saved to cache
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42332d0>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/3.jpg saved to cache
2026-01-28 20:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4230810>
2026-01-28 20:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/1.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c4290>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/5.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:31 [ayvens.fr] INFO: Found listing with ID: 1877928
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877928%27 HTTP/1.1" 200 None
2026-01-28 20:04:31 [ayvens.fr] INFO: Scrape type for 1877928: 1
2026-01-28 20:04:31 [ayvens.fr] INFO: Extracting data for car ID: 1877928
2026-01-28 20:04:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 with identifier: 1877928
2026-01-28 20:04:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 with scrape type 1
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/1.jpg not downloaded yet
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cf190>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/6.jpg saved to cache
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/2.jpg not downloaded yet
2026-01-28 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/3.jpg not downloaded yet
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c451a190>
2026-01-28 20:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/7.jpg saved to cache
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dd6d0>
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252F1ae76a082157428f86e61c253e864275%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/8.jpg saved to cache
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc
2026-01-28 20:04:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aee8ae6c-1193-5878-9bea-1bc1e19cc0cc, skipping ID generation
2026-01-28 20:04:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc with scrape type 1
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc from tracking dictionaries
2026-01-28 20:04:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aee8ae6c-1193-5878-9bea-1bc1e19cc0cc sending to next pipeline
2026-01-28 20:04:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aee8ae6c-1193-5878-9bea-1bc1e19cc0cc, identifier: 1877926
2026-01-28 20:04:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aee8ae6c-1193-5878-9bea-1bc1e19cc0cc with identifier: 1877926
2026-01-28 20:04:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aee8ae6c-1193-5878-9bea-1bc1e19cc0cc with identifier: 1877926
2026-01-28 20:04:32 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: aee8ae6c-1193-5878-9bea-1bc1e19cc0cc with identifier: 1877926 to the API
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'aee8ae6c-1193-5878-9bea-1bc1e19cc0cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 48448,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352496,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334484,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312400,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aee8ae6c-1193-5878-9bea-1bc1e19cc0cc/aee8ae6c-1193-5878-9bea-1bc1e19cc0cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/1ae76a082157428f86e61c253e864275/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-02-17',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Sté 1.0 SCe 65ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Sté 1.0 SCe 65ch Air Nav',
'vin': None,
'year': 2021}
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877926%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [ayvens.fr] INFO: Saving data for 1877926: {'created_time': 1769630673.109047, 'last_price_update_time': 1769630673.10906, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877926') HTTP/1.1" 204 0
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/4.jpg not downloaded yet
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4157410>
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/1.jpg saved to cache
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4156890>
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/3.jpg saved to cache
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/5.jpg not downloaded yet
2026-01-28 20:04:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/6.jpg not downloaded yet
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a48d0>
2026-01-28 20:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/4.jpg saved to cache
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c405a150>
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/2.jpg saved to cache
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4231d90>
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/5.jpg saved to cache
2026-01-28 20:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458bc10>
2026-01-28 20:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/6.jpg saved to cache
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4584b10>
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/7.jpg saved to cache
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/7.jpg not downloaded yet
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4281350>
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252Fd88697cc8fa4452b87af13f922d18e8b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/8.jpg saved to cache
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234
2026-01-28 20:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5601c7f2-5824-598b-97b9-fbf5fc3b9234, skipping ID generation
2026-01-28 20:04:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234 with scrape type 1
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5601c7f2-5824-598b-97b9-fbf5fc3b9234 from tracking dictionaries
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5601c7f2-5824-598b-97b9-fbf5fc3b9234 sending to next pipeline
2026-01-28 20:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5601c7f2-5824-598b-97b9-fbf5fc3b9234, identifier: 1877927
2026-01-28 20:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/8.jpg not downloaded yet
2026-01-28 20:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5601c7f2-5824-598b-97b9-fbf5fc3b9234 with identifier: 1877927
2026-01-28 20:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5601c7f2-5824-598b-97b9-fbf5fc3b9234 with identifier: 1877927
2026-01-28 20:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 5601c7f2-5824-598b-97b9-fbf5fc3b9234 spider: ayvens.fr
2026-01-28 20:04:35 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 5601c7f2-5824-598b-97b9-fbf5fc3b9234 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
'c_o_2_emission_value': 122,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '5601c7f2-5824-598b-97b9-fbf5fc3b9234',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 123938,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337948,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430676,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344184,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377105,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5601c7f2-5824-598b-97b9-fbf5fc3b9234/5601c7f2-5824-598b-97b9-fbf5fc3b9234_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 248498,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/d88697cc8fa4452b87af13f922d18e8b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-30',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'transmission': 'manual',
'trim': 'Jumpy Fg M 1.5 BlueHDi 120ch S&S Driver',
'vin': None,
'year': 2020}
2026-01-28 20:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877927%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [ayvens.fr] INFO: Saving data for 1877927: {'created_time': 1769630676.004406, 'last_price_update_time': 1769630676.00442, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877927') HTTP/1.1" 204 0
2026-01-28 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:36 [ayvens.fr] INFO: Found listing with ID: 1877929
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877929%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [ayvens.fr] INFO: Scrape type for 1877929: 1
2026-01-28 20:04:36 [ayvens.fr] INFO: Extracting data for car ID: 1877929
2026-01-28 20:04:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a33828a-1a15-5731-8c4d-75b34433656a with identifier: 1877929
2026-01-28 20:04:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a33828a-1a15-5731-8c4d-75b34433656a with scrape type 1
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/1.jpg not downloaded yet
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c405af10>
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/1.jpg saved to cache
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff78a10>
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/2.jpg saved to cache
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/2.jpg not downloaded yet
2026-01-28 20:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/3.jpg not downloaded yet
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c82f5890>
2026-01-28 20:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/4.jpg saved to cache
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/4.jpg not downloaded yet
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/5.jpg not downloaded yet
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416f110>
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/3.jpg saved to cache
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4335c10>
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/5.jpg saved to cache
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/6.jpg not downloaded yet
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/7.jpg not downloaded yet
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41efb90>
2026-01-28 20:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/6.jpg saved to cache
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c75741d0>
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/7.jpg saved to cache
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/8.jpg not downloaded yet
2026-01-28 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:38 [ayvens.fr] INFO: Found listing with ID: 1877930
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877930%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [ayvens.fr] INFO: Scrape type for 1877930: 1
2026-01-28 20:04:38 [ayvens.fr] INFO: Extracting data for car ID: 1877930
2026-01-28 20:04:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6cdbcb3-2406-59f6-aa09-77ed88963621 with identifier: 1877930
2026-01-28 20:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6cdbcb3-2406-59f6-aa09-77ed88963621 with scrape type 1
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/1.jpg not downloaded yet
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4507510>
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F2ed2294bd2c5474cbb3eddd964b46c39%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/8.jpg saved to cache
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072
2026-01-28 20:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072, skipping ID generation
2026-01-28 20:04:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 with scrape type 1
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 from tracking dictionaries
2026-01-28 20:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 sending to next pipeline
2026-01-28 20:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072, identifier: 1877928
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaee3d0>
2026-01-28 20:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/1.jpg saved to cache
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 with identifier: 1877928
2026-01-28 20:04:39 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 with identifier: 1877928
2026-01-28 20:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072 with identifier: 1877928 to the API
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'GRIS ATLAS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'C-HR',
'odometer': 90257,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423440,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427889,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 324523,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318967,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320976,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072/a5b5ded0-8e0b-5bf6-852a-6cb21c9f4072_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/2ed2294bd2c5474cbb3eddd964b46c39/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-02',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA C-HR C-HR 122h Dynamic Business 2WD E-CVT + Programme Beyond '
'Zero Academy MY22',
'transmission': 'automatic',
'trim': 'C-HR 122h Dynamic Business 2WD E-CVT + Programme Beyond Zero Academy '
'MY22',
'vin': None,
'year': 2022}
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877928%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [ayvens.fr] INFO: Saving data for 1877928: {'created_time': 1769630679.723531, 'last_price_update_time': 1769630679.723546, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877928') HTTP/1.1" 204 0
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/2.jpg not downloaded yet
2026-01-28 20:04:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4297190>
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/3.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4418a90>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/2.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/3.jpg not downloaded yet
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/4.jpg not downloaded yet
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406d290>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/5.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2a2d0>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/4.jpg saved to cache
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/5.jpg not downloaded yet
2026-01-28 20:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4507450>
2026-01-28 20:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/7.jpg saved to cache
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf141350>
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/6.jpg saved to cache
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/6.jpg not downloaded yet
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/7.jpg not downloaded yet
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40d9390>
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F6acdbb9e658449fd970522756d9626f8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/8.jpg saved to cache
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a33828a-1a15-5731-8c4d-75b34433656a
2026-01-28 20:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a33828a-1a15-5731-8c4d-75b34433656a, skipping ID generation
2026-01-28 20:04:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a33828a-1a15-5731-8c4d-75b34433656a with scrape type 1
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6a33828a-1a15-5731-8c4d-75b34433656a from tracking dictionaries
2026-01-28 20:04:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a33828a-1a15-5731-8c4d-75b34433656a sending to next pipeline
2026-01-28 20:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6a33828a-1a15-5731-8c4d-75b34433656a, identifier: 1877929
2026-01-28 20:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6a33828a-1a15-5731-8c4d-75b34433656a with identifier: 1877929
2026-01-28 20:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6a33828a-1a15-5731-8c4d-75b34433656a with identifier: 1877929
2026-01-28 20:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6a33828a-1a15-5731-8c4d-75b34433656a with identifier: 1877929 to the API
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '6a33828a-1a15-5731-8c4d-75b34433656a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 121271,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380959,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240032,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312373,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164111,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a33828a-1a15-5731-8c4d-75b34433656a/6a33828a-1a15-5731-8c4d-75b34433656a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 313935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/6acdbb9e658449fd970522756d9626f8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877929%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [ayvens.fr] INFO: Saving data for 1877929: {'created_time': 1769630682.425685, 'last_price_update_time': 1769630682.425696, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877929') HTTP/1.1" 204 0
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/8.jpg not downloaded yet
2026-01-28 20:04:42 [ayvens.fr] INFO: Found listing with ID: 1877931
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877931%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [ayvens.fr] INFO: Scrape type for 1877931: 1
2026-01-28 20:04:42 [ayvens.fr] INFO: Extracting data for car ID: 1877931
2026-01-28 20:04:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06060bbe-5ed7-520b-857a-21facb788c40 with identifier: 1877931
2026-01-28 20:04:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06060bbe-5ed7-520b-857a-21facb788c40 with scrape type 1
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/1.jpg not downloaded yet
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/2.jpg not downloaded yet
2026-01-28 20:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/3.jpg not downloaded yet
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/4.jpg not downloaded yet
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dea10>
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/1.jpg saved to cache
2026-01-28 20:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a5350>
2026-01-28 20:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/2.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/5.jpg not downloaded yet
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/6.jpg not downloaded yet
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c451be10>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/3.jpg saved to cache
2026-01-28 20:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c21d0>
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/5.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c404b750>
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/4.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/7.jpg not downloaded yet
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/8.jpg not downloaded yet
2026-01-28 20:04:44 [ayvens.fr] INFO: Found listing with ID: 1877932
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877932%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [ayvens.fr] INFO: Scrape type for 1877932: 1
2026-01-28 20:04:44 [ayvens.fr] INFO: Extracting data for car ID: 1877932
2026-01-28 20:04:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eacf593f-c33d-52b2-b43e-6e782f0840ec with identifier: 1877932
2026-01-28 20:04:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eacf593f-c33d-52b2-b43e-6e782f0840ec with scrape type 1
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/1.jpg not downloaded yet
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/2.jpg not downloaded yet
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/3.jpg not downloaded yet
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c2a10>
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/2.jpg saved to cache
2026-01-28 20:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4140e10>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/1.jpg saved to cache
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40c81d0>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/6.jpg saved to cache
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/4.jpg not downloaded yet
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e3a50>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/8.jpg saved to cache
2026-01-28 20:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1a2090>
2026-01-28 20:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F6fef0fb86db94789808d2741fdd0d022%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/7.jpg saved to cache
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6cdbcb3-2406-59f6-aa09-77ed88963621
2026-01-28 20:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6cdbcb3-2406-59f6-aa09-77ed88963621, skipping ID generation
2026-01-28 20:04:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6cdbcb3-2406-59f6-aa09-77ed88963621 with scrape type 1
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b6cdbcb3-2406-59f6-aa09-77ed88963621 from tracking dictionaries
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6cdbcb3-2406-59f6-aa09-77ed88963621 sending to next pipeline
2026-01-28 20:04:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b6cdbcb3-2406-59f6-aa09-77ed88963621, identifier: 1877930
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/5.jpg not downloaded yet
2026-01-28 20:04:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b6cdbcb3-2406-59f6-aa09-77ed88963621 with identifier: 1877930
2026-01-28 20:04:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b6cdbcb3-2406-59f6-aa09-77ed88963621 with identifier: 1877930
2026-01-28 20:04:46 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b6cdbcb3-2406-59f6-aa09-77ed88963621 with identifier: 1877930 to the API
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:04:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'b6cdbcb3-2406-59f6-aa09-77ed88963621',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 49699,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 434997,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312455,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291154,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340110,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6cdbcb3-2406-59f6-aa09-77ed88963621/b6cdbcb3-2406-59f6-aa09-77ed88963621_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428809,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/6fef0fb86db94789808d2741fdd0d022/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-08',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 SCe 65ch Business',
'transmission': 'manual',
'trim': 'Clio 1.0 SCe 65ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877930%27 HTTP/1.1" 200 None
2026-01-28 20:04:46 [ayvens.fr] INFO: Saving data for 1877930: {'created_time': 1769630686.843792, 'last_price_update_time': 1769630686.843803, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877930') HTTP/1.1" 204 0
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a62d0>
2026-01-28 20:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/4.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b0d50>
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/3.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/6.jpg not downloaded yet
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41e5150>
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/5.jpg saved to cache
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/7.jpg not downloaded yet
2026-01-28 20:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/8.jpg not downloaded yet
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4576ed0>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/6.jpg saved to cache
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e3f50>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/7.jpg saved to cache
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:48 [ayvens.fr] INFO: Found listing with ID: 1877933
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877933%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [ayvens.fr] INFO: Scrape type for 1877933: 1
2026-01-28 20:04:48 [ayvens.fr] INFO: Extracting data for car ID: 1877933
2026-01-28 20:04:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a230155b-489b-531a-a3a8-395c9c765470 with identifier: 1877933
2026-01-28 20:04:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a230155b-489b-531a-a3a8-395c9c765470 with scrape type 1
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/1.jpg not downloaded yet
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ed010>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/1.jpg saved to cache
2026-01-28 20:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45879d0>
2026-01-28 20:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/2.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/2.jpg not downloaded yet
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/3.jpg not downloaded yet
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4576850>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/3.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4049d50>
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252F38e150f7679c4216911c271b697f1d28%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/8.jpg saved to cache
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06060bbe-5ed7-520b-857a-21facb788c40
2026-01-28 20:04:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06060bbe-5ed7-520b-857a-21facb788c40, skipping ID generation
2026-01-28 20:04:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06060bbe-5ed7-520b-857a-21facb788c40 with scrape type 1
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 06060bbe-5ed7-520b-857a-21facb788c40 from tracking dictionaries
2026-01-28 20:04:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06060bbe-5ed7-520b-857a-21facb788c40 sending to next pipeline
2026-01-28 20:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 06060bbe-5ed7-520b-857a-21facb788c40, identifier: 1877931
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 06060bbe-5ed7-520b-857a-21facb788c40 with identifier: 1877931
2026-01-28 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 06060bbe-5ed7-520b-857a-21facb788c40 with identifier: 1877931
2026-01-28 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 134814 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
134814
2026-01-28 20:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 06060bbe-5ed7-520b-857a-21facb788c40 spider: ayvens.fr
2026-01-28 20:04:50 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 06060bbe-5ed7-520b-857a-21facb788c40 due to rule: high_mileage_for_make.json, error: 134814 is greater than the maximum of 130000
Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
{'maximum': 130000, 'type': 'integer'}
On instance['odometer_in_km']:
134814
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '06060bbe-5ed7-520b-857a-21facb788c40',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '2008',
'odometer': 134814,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290980,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447225,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 238062,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06060bbe-5ed7-520b-857a-21facb788c40/06060bbe-5ed7-520b-857a-21facb788c40_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 590830,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/38e150f7679c4216911c271b697f1d28/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 2008 2008 1.5 BlueHDi 110ch S&S Active Business',
'transmission': 'manual',
'trim': '2008 1.5 BlueHDi 110ch S&S Active Business',
'vin': None,
'year': 2021}
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877931%27 HTTP/1.1" 200 None
2026-01-28 20:04:50 [ayvens.fr] INFO: Saving data for 1877931: {'created_time': 1769630690.248122, 'last_price_update_time': 1769630690.248135, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877931') HTTP/1.1" 204 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/4.jpg not downloaded yet
2026-01-28 20:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c0850>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/4.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/5.jpg not downloaded yet
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4337090>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/6.jpg saved to cache
2026-01-28 20:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4337390>
2026-01-28 20:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/5.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/6.jpg not downloaded yet
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfafe190>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/7.jpg saved to cache
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/7.jpg not downloaded yet
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/8.jpg not downloaded yet
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:51 [ayvens.fr] INFO: Found listing with ID: 1877934
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877934%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [ayvens.fr] INFO: Scrape type for 1877934: 1
2026-01-28 20:04:51 [ayvens.fr] INFO: Extracting data for car ID: 1877934
2026-01-28 20:04:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1f02c62c-d93a-5b98-a253-812cd3bff229 with identifier: 1877934
2026-01-28 20:04:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f02c62c-d93a-5b98-a253-812cd3bff229 with scrape type 1
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/1.jpg not downloaded yet
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/2.jpg not downloaded yet
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/3.jpg not downloaded yet
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a75d0>
2026-01-28 20:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Faf5e205315ca4692886a6230aa6fb5bc%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/8.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item eacf593f-c33d-52b2-b43e-6e782f0840ec
2026-01-28 20:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eacf593f-c33d-52b2-b43e-6e782f0840ec, skipping ID generation
2026-01-28 20:04:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eacf593f-c33d-52b2-b43e-6e782f0840ec with scrape type 1
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eacf593f-c33d-52b2-b43e-6e782f0840ec from tracking dictionaries
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eacf593f-c33d-52b2-b43e-6e782f0840ec sending to next pipeline
2026-01-28 20:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: eacf593f-c33d-52b2-b43e-6e782f0840ec, identifier: 1877932
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfb32c10>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/1.jpg saved to cache
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/4.jpg not downloaded yet
2026-01-28 20:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: eacf593f-c33d-52b2-b43e-6e782f0840ec with identifier: 1877932
2026-01-28 20:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: eacf593f-c33d-52b2-b43e-6e782f0840ec with identifier: 1877932
2026-01-28 20:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: eacf593f-c33d-52b2-b43e-6e782f0840ec spider: ayvens.fr
2026-01-28 20:04:52 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: eacf593f-c33d-52b2-b43e-6e782f0840ec due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'eacf593f-c33d-52b2-b43e-6e782f0840ec',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'KADJAR',
'odometer': 90442,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329804,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332787,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 350078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352210,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343340,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295906,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eacf593f-c33d-52b2-b43e-6e782f0840ec/eacf593f-c33d-52b2-b43e-6e782f0840ec_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379347,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/af5e205315ca4692886a6230aa6fb5bc/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-02-26',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT KADJAR Kadjar 1.5 Blue dCi 115ch Business',
'transmission': 'manual',
'trim': 'Kadjar 1.5 Blue dCi 115ch Business',
'vin': None,
'year': 2019}
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877932%27 HTTP/1.1" 200 None
2026-01-28 20:04:52 [ayvens.fr] INFO: Saving data for 1877932: {'created_time': 1769630692.894029, 'last_price_update_time': 1769630692.89404, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877932') HTTP/1.1" 204 0
2026-01-28 20:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/5.jpg not downloaded yet
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452b290>
2026-01-28 20:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/2.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff16a50>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/3.jpg saved to cache
2026-01-28 20:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b7350>
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/4.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/6.jpg not downloaded yet
2026-01-28 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419e710>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/5.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/7.jpg not downloaded yet
2026-01-28 20:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/8.jpg not downloaded yet
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4141890>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/7.jpg saved to cache
2026-01-28 20:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44df590>
2026-01-28 20:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/8.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b34d0>
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F94b3278ac8714246a92ba0ac01098e0e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/6.jpg saved to cache
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a230155b-489b-531a-a3a8-395c9c765470
2026-01-28 20:04:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a230155b-489b-531a-a3a8-395c9c765470, skipping ID generation
2026-01-28 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a230155b-489b-531a-a3a8-395c9c765470 with scrape type 1
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a230155b-489b-531a-a3a8-395c9c765470 from tracking dictionaries
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a230155b-489b-531a-a3a8-395c9c765470 sending to next pipeline
2026-01-28 20:04:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a230155b-489b-531a-a3a8-395c9c765470, identifier: 1877933
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [ayvens.fr] INFO: Found listing with ID: 1877935
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877935%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [ayvens.fr] INFO: Scrape type for 1877935: 1
2026-01-28 20:04:55 [ayvens.fr] INFO: Extracting data for car ID: 1877935
2026-01-28 20:04:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c1470c4-014c-5969-b509-644da6cc77ba with identifier: 1877935
2026-01-28 20:04:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c1470c4-014c-5969-b509-644da6cc77ba with scrape type 1
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/1.jpg not downloaded yet
2026-01-28 20:04:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a230155b-489b-531a-a3a8-395c9c765470 with identifier: 1877933
2026-01-28 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a230155b-489b-531a-a3a8-395c9c765470 with identifier: 1877933
2026-01-28 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:55 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: a230155b-489b-531a-a3a8-395c9c765470 spider: ayvens.fr
2026-01-28 20:04:55 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: a230155b-489b-531a-a3a8-395c9c765470 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 120,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'a230155b-489b-531a-a3a8-395c9c765470',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'SUZUKI',
'model': 'VITARA',
'odometer': 46568,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325717,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311894,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363955,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a230155b-489b-531a-a3a8-395c9c765470/a230155b-489b-531a-a3a8-395c9c765470_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/94b3278ac8714246a92ba0ac01098e0e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-11-10',
'seats_number': 5,
'seller_name': None,
'title': 'SUZUKI VITARA Vitara 1.4 Boosterjet Hybrid 129ch Privilège',
'transmission': 'manual',
'trim': 'Vitara 1.4 Boosterjet Hybrid 129ch Privilège',
'vin': None,
'year': 2023}
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877933%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [ayvens.fr] INFO: Saving data for 1877933: {'created_time': 1769630695.950962, 'last_price_update_time': 1769630695.951031, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877933') HTTP/1.1" 204 0
2026-01-28 20:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/2.jpg not downloaded yet
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ef9d0>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/1.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4349310>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/2.jpg saved to cache
2026-01-28 20:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4305290>
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/3.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/3.jpg not downloaded yet
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/4.jpg not downloaded yet
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a4b10>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/4.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/5.jpg not downloaded yet
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/6.jpg not downloaded yet
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458b890>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/5.jpg saved to cache
2026-01-28 20:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44ddc50>
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/6.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441a290>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/7.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/7.jpg not downloaded yet
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/8.jpg not downloaded yet
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [ayvens.fr] INFO: Found listing with ID: 1877936
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877936%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [ayvens.fr] INFO: Scrape type for 1877936: 1
2026-01-28 20:04:58 [ayvens.fr] INFO: Extracting data for car ID: 1877936
2026-01-28 20:04:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28598e18-d9ab-5b55-8b21-ae4046161a8a with identifier: 1877936
2026-01-28 20:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28598e18-d9ab-5b55-8b21-ae4046161a8a with scrape type 1
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/1.jpg not downloaded yet
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/2.jpg not downloaded yet
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/3.jpg not downloaded yet
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4374a90>
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252F4234f578b49940529e853c80c102b90e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/8.jpg saved to cache
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1f02c62c-d93a-5b98-a253-812cd3bff229
2026-01-28 20:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1f02c62c-d93a-5b98-a253-812cd3bff229, skipping ID generation
2026-01-28 20:04:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1f02c62c-d93a-5b98-a253-812cd3bff229 with scrape type 1
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1f02c62c-d93a-5b98-a253-812cd3bff229 from tracking dictionaries
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1f02c62c-d93a-5b98-a253-812cd3bff229 sending to next pipeline
2026-01-28 20:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 1f02c62c-d93a-5b98-a253-812cd3bff229, identifier: 1877934
2026-01-28 20:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/4.jpg not downloaded yet
2026-01-28 20:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 1f02c62c-d93a-5b98-a253-812cd3bff229 with identifier: 1877934
2026-01-28 20:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 1f02c62c-d93a-5b98-a253-812cd3bff229 with identifier: 1877934
2026-01-28 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 1f02c62c-d93a-5b98-a253-812cd3bff229 spider: ayvens.fr
2026-01-28 20:04:59 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 1f02c62c-d93a-5b98-a253-812cd3bff229 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 136,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '1f02c62c-d93a-5b98-a253-812cd3bff229',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'GRANDLAND',
'odometer': 75820,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423506,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392733,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365769,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303817,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1f02c62c-d93a-5b98-a253-812cd3bff229/1f02c62c-d93a-5b98-a253-812cd3bff229_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 499822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/4234f578b49940529e853c80c102b90e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-19',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL GRANDLAND Grandland 1.5 D 130ch Elegance Business BVA8',
'transmission': 'automatic',
'trim': 'Grandland 1.5 D 130ch Elegance Business BVA8',
'vin': None,
'year': 2022}
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877934%27 HTTP/1.1" 200 None
2026-01-28 20:04:59 [ayvens.fr] INFO: Saving data for 1877934: {'created_time': 1769630699.150172, 'last_price_update_time': 1769630699.150182, 'auction_closing_time': 1769695200.0}
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877934') HTTP/1.1" 204 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/5.jpg not downloaded yet
2026-01-28 20:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff52050>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/2.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43225d0>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/1.jpg saved to cache
2026-01-28 20:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d29d0>
2026-01-28 20:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/3.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4321c90>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/4.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff54210>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/5.jpg saved to cache
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/6.jpg not downloaded yet
2026-01-28 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/7.jpg not downloaded yet
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e5550>
2026-01-28 20:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/6.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/8.jpg not downloaded yet
2026-01-28 20:05:01 [ayvens.fr] INFO: Found listing with ID: 1877937
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877937%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [ayvens.fr] INFO: Scrape type for 1877937: 1
2026-01-28 20:05:01 [ayvens.fr] INFO: Extracting data for car ID: 1877937
2026-01-28 20:05:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd with identifier: 1877937
2026-01-28 20:05:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd with scrape type 1
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/1.jpg not downloaded yet
2026-01-28 20:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43748d0>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/7.jpg saved to cache
2026-01-28 20:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42836d0>
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/1.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1a2590>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffn-%252F2e115295e3a14d0c9e918131a6964545%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/8.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6c1470c4-014c-5969-b509-644da6cc77ba
2026-01-28 20:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6c1470c4-014c-5969-b509-644da6cc77ba, skipping ID generation
2026-01-28 20:05:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c1470c4-014c-5969-b509-644da6cc77ba with scrape type 1
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6c1470c4-014c-5969-b509-644da6cc77ba from tracking dictionaries
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6c1470c4-014c-5969-b509-644da6cc77ba sending to next pipeline
2026-01-28 20:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6c1470c4-014c-5969-b509-644da6cc77ba, identifier: 1877935
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaedc90>
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/2.jpg saved to cache
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/2.jpg not downloaded yet
2026-01-28 20:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6c1470c4-014c-5969-b509-644da6cc77ba with identifier: 1877935
2026-01-28 20:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6c1470c4-014c-5969-b509-644da6cc77ba with identifier: 1877935
2026-01-28 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
2026-01-28 20:05:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 6c1470c4-014c-5969-b509-644da6cc77ba spider: ayvens.fr
2026-01-28 20:05:03 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6c1470c4-014c-5969-b509-644da6cc77ba due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'partner' containing 'partner'
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '6c1470c4-014c-5969-b509-644da6cc77ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'PARTNER',
'odometer': 70963,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484847,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346152,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302208,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 240613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6c1470c4-014c-5969-b509-644da6cc77ba/6c1470c4-014c-5969-b509-644da6cc77ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fn-/2e115295e3a14d0c9e918131a6964545/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-02-13',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT PARTNER Partner Standard 1000kg BlueHDi 100ch S&S Asphalt',
'transmission': 'manual',
'trim': 'Partner Standard 1000kg BlueHDi 100ch S&S Asphalt',
'vin': None,
'year': 2020}
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877935%27 HTTP/1.1" 200 None
2026-01-28 20:05:03 [ayvens.fr] INFO: Saving data for 1877935: {'created_time': 1769630703.142138, 'last_price_update_time': 1769630703.142148, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877935') HTTP/1.1" 204 0
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/3.jpg not downloaded yet
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44df850>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/3.jpg saved to cache
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/4.jpg not downloaded yet
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/5.jpg not downloaded yet
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4545690>
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/4.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e3c90>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/5.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/6.jpg not downloaded yet
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/7.jpg not downloaded yet
2026-01-28 20:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4156010>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/6.jpg saved to cache
2026-01-28 20:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b9bd0>
2026-01-28 20:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/7.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406c550>
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8a8cc8cd101a4953ba4272063ba10b67%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/8.jpg saved to cache
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28598e18-d9ab-5b55-8b21-ae4046161a8a
2026-01-28 20:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28598e18-d9ab-5b55-8b21-ae4046161a8a, skipping ID generation
2026-01-28 20:05:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28598e18-d9ab-5b55-8b21-ae4046161a8a with scrape type 1
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 28598e18-d9ab-5b55-8b21-ae4046161a8a from tracking dictionaries
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28598e18-d9ab-5b55-8b21-ae4046161a8a sending to next pipeline
2026-01-28 20:05:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 28598e18-d9ab-5b55-8b21-ae4046161a8a, identifier: 1877936
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/8.jpg not downloaded yet
2026-01-28 20:05:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 28598e18-d9ab-5b55-8b21-ae4046161a8a with identifier: 1877936
2026-01-28 20:05:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 28598e18-d9ab-5b55-8b21-ae4046161a8a with identifier: 1877936
2026-01-28 20:05:05 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 28598e18-d9ab-5b55-8b21-ae4046161a8a with identifier: 1877936 to the API
2026-01-28 20:05:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 133,
'color': 'NOIR METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '28598e18-d9ab-5b55-8b21-ae4046161a8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'ARKANA',
'odometer': 92898,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319468,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 437694,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386904,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399350,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369302,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28598e18-d9ab-5b55-8b21-ae4046161a8a/28598e18-d9ab-5b55-8b21-ae4046161a8a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305262,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8a8cc8cd101a4953ba4272063ba10b67/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT ARKANA Arkana 1.3 TCe mild hybrid 140ch Techno EDC',
'transmission': 'automatic',
'trim': 'Arkana 1.3 TCe mild hybrid 140ch Techno EDC',
'vin': None,
'year': 2023}
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877936%27 HTTP/1.1" 200 None
2026-01-28 20:05:06 [ayvens.fr] INFO: Saving data for 1877936: {'created_time': 1769630706.885391, 'last_price_update_time': 1769630706.885401, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877936') HTTP/1.1" 204 0
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [ayvens.fr] INFO: Found listing with ID: 1877938
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877938%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [ayvens.fr] INFO: Scrape type for 1877938: 1
2026-01-28 20:05:07 [ayvens.fr] INFO: Extracting data for car ID: 1877938
2026-01-28 20:05:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bde497a-7079-55e8-9d80-1a860d1a6f68 with identifier: 1877938
2026-01-28 20:05:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bde497a-7079-55e8-9d80-1a860d1a6f68 with scrape type 1
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/1.jpg not downloaded yet
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a5cd0>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/1.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/2.jpg not downloaded yet
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/3.jpg not downloaded yet
2026-01-28 20:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4334f90>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/3.jpg saved to cache
2026-01-28 20:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff36cd0>
2026-01-28 20:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/2.jpg saved to cache
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/4.jpg not downloaded yet
2026-01-28 20:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/5.jpg not downloaded yet
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4537ed0>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/5.jpg saved to cache
2026-01-28 20:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff28dd0>
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/4.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45292d0>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/6.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/6.jpg not downloaded yet
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c7210>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/7.jpg saved to cache
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/7.jpg not downloaded yet
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/8.jpg not downloaded yet
2026-01-28 20:05:09 [ayvens.fr] INFO: Found listing with ID: 1877939
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877939%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [ayvens.fr] INFO: Scrape type for 1877939: 1
2026-01-28 20:05:09 [ayvens.fr] INFO: Extracting data for car ID: 1877939
2026-01-28 20:05:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c28ebf-b884-5360-a32a-2cba32239491 with identifier: 1877939
2026-01-28 20:05:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c28ebf-b884-5360-a32a-2cba32239491 with scrape type 1
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/1.jpg not downloaded yet
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/2.jpg not downloaded yet
2026-01-28 20:05:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/3.jpg not downloaded yet
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/4.jpg not downloaded yet
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/5.jpg not downloaded yet
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e35d0>
2026-01-28 20:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/1.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4219090>
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252F3cfc050a1cb24b039dcbc05df7476068%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/8.jpg saved to cache
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd
2026-01-28 20:05:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd, skipping ID generation
2026-01-28 20:05:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd with scrape type 1
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd from tracking dictionaries
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30945cc5-757b-5192-9c4b-cac7ea7ff8dd sending to next pipeline
2026-01-28 20:05:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd, identifier: 1877937
2026-01-28 20:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/6.jpg not downloaded yet
2026-01-28 20:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd with identifier: 1877937
2026-01-28 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd with identifier: 1877937
2026-01-28 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
2026-01-28 20:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd spider: ayvens.fr
2026-01-28 20:05:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 30945cc5-757b-5192-9c4b-cac7ea7ff8dd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'opel' containing 'opel' and model 'combo' containing 'combo'
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '30945cc5-757b-5192-9c4b-cac7ea7ff8dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'COMBO',
'odometer': 31614,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319829,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362332,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312166,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30945cc5-757b-5192-9c4b-cac7ea7ff8dd/30945cc5-757b-5192-9c4b-cac7ea7ff8dd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 500634,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/3cfc050a1cb24b039dcbc05df7476068/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-04-27',
'seats_number': 2,
'seller_name': None,
'title': 'OPEL COMBO Combo Cargo L2H1 Augmenté 1.5 100ch S&S Pack Clim',
'transmission': 'manual',
'trim': 'Combo Cargo L2H1 Augmenté 1.5 100ch S&S Pack Clim',
'vin': None,
'year': 2022}
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877937%27 HTTP/1.1" 200 None
2026-01-28 20:05:11 [ayvens.fr] INFO: Saving data for 1877937: {'created_time': 1769630711.07042, 'last_price_update_time': 1769630711.070432, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877937') HTTP/1.1" 204 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/7.jpg not downloaded yet
2026-01-28 20:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/8.jpg not downloaded yet
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416ec10>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/2.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4506d10>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/3.jpg saved to cache
2026-01-28 20:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e2110>
2026-01-28 20:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/4.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4155fd0>
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/5.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [ayvens.fr] INFO: Found listing with ID: 1877940
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877940%27 HTTP/1.1" 200 None
2026-01-28 20:05:12 [ayvens.fr] INFO: Scrape type for 1877940: 1
2026-01-28 20:05:12 [ayvens.fr] INFO: Extracting data for car ID: 1877940
2026-01-28 20:05:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d1d55c5-7ccc-5e39-a428-7430f2848324 with identifier: 1877940
2026-01-28 20:05:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1d55c5-7ccc-5e39-a428-7430f2848324 with scrape type 1
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg not downloaded yet
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg not downloaded yet
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425d590>
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/7.jpg saved to cache
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg not downloaded yet
2026-01-28 20:05:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg not downloaded yet
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407fa50>
2026-01-28 20:05:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/6.jpg saved to cache
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4466510>
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/1.jpg saved to cache
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435f950>
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/2.jpg saved to cache
2026-01-28 20:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42be410>
2026-01-28 20:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/3.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46b71d0>
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/4.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f8b90>
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F16aba2221d9f4536a6e6436aba10b6a5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/8.jpg saved to cache
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bde497a-7079-55e8-9d80-1a860d1a6f68
2026-01-28 20:05:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bde497a-7079-55e8-9d80-1a860d1a6f68, skipping ID generation
2026-01-28 20:05:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bde497a-7079-55e8-9d80-1a860d1a6f68 with scrape type 1
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bde497a-7079-55e8-9d80-1a860d1a6f68 from tracking dictionaries
2026-01-28 20:05:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bde497a-7079-55e8-9d80-1a860d1a6f68 sending to next pipeline
2026-01-28 20:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6bde497a-7079-55e8-9d80-1a860d1a6f68, identifier: 1877938
2026-01-28 20:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6bde497a-7079-55e8-9d80-1a860d1a6f68 with identifier: 1877938
2026-01-28 20:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6bde497a-7079-55e8-9d80-1a860d1a6f68 with identifier: 1877938
2026-01-28 20:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 6bde497a-7079-55e8-9d80-1a860d1a6f68 with identifier: 1877938 to the API
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'BLEU C',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '6bde497a-7079-55e8-9d80-1a860d1a6f68',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '5008',
'odometer': 82475,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455114,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474445,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407083,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430253,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 389204,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bde497a-7079-55e8-9d80-1a860d1a6f68/6bde497a-7079-55e8-9d80-1a860d1a6f68_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 480730,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/16aba2221d9f4536a6e6436aba10b6a5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-31',
'seats_number': 7,
'seller_name': None,
'title': 'PEUGEOT 5008 5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '5008 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877938%27 HTTP/1.1" 200 None
2026-01-28 20:05:16 [ayvens.fr] INFO: Saving data for 1877938: {'created_time': 1769630716.076499, 'last_price_update_time': 1769630716.076509, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877938') HTTP/1.1" 204 0
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg not downloaded yet
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ce390>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/5.jpg saved to cache
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg not downloaded yet
2026-01-28 20:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg not downloaded yet
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4305c90>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/7.jpg saved to cache
2026-01-28 20:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e37d0>
2026-01-28 20:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/6.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg not downloaded yet
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [ayvens.fr] INFO: Found listing with ID: 1877941
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877941%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [ayvens.fr] INFO: Scrape type for 1877941: 1
2026-01-28 20:05:17 [ayvens.fr] INFO: Extracting data for car ID: 1877941
2026-01-28 20:05:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d19efd59-ecff-5ae3-9308-a7e12bb28a00 with identifier: 1877941
2026-01-28 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19efd59-ecff-5ae3-9308-a7e12bb28a00 with scrape type 1
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/1.jpg not downloaded yet
2026-01-28 20:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff785d0>
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F29172ff1fd3741f5879e5e554853af85%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/8.jpg saved to cache
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f8c28ebf-b884-5360-a32a-2cba32239491
2026-01-28 20:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f8c28ebf-b884-5360-a32a-2cba32239491, skipping ID generation
2026-01-28 20:05:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c28ebf-b884-5360-a32a-2cba32239491 with scrape type 1
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f8c28ebf-b884-5360-a32a-2cba32239491 from tracking dictionaries
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f8c28ebf-b884-5360-a32a-2cba32239491 sending to next pipeline
2026-01-28 20:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f8c28ebf-b884-5360-a32a-2cba32239491, identifier: 1877939
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/2.jpg not downloaded yet
2026-01-28 20:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f8c28ebf-b884-5360-a32a-2cba32239491 with identifier: 1877939
2026-01-28 20:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f8c28ebf-b884-5360-a32a-2cba32239491 with identifier: 1877939
2026-01-28 20:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f8c28ebf-b884-5360-a32a-2cba32239491 with identifier: 1877939 to the API
2026-01-28 20:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'f8c28ebf-b884-5360-a32a-2cba32239491',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 88913,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412203,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 415731,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 440142,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f8c28ebf-b884-5360-a32a-2cba32239491/f8c28ebf-b884-5360-a32a-2cba32239491_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429185,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/29172ff1fd3741f5879e5e554853af85/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-10-19',
'seats_number': 2,
'seller_name': None,
'title': 'PEUGEOT 208 208 Affaire 1.5 BlueHDi 100 Premium Pack',
'transmission': 'manual',
'trim': '208 Affaire 1.5 BlueHDi 100 Premium Pack',
'vin': None,
'year': 2021}
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877939%27 HTTP/1.1" 200 None
2026-01-28 20:05:18 [ayvens.fr] INFO: Saving data for 1877939: {'created_time': 1769630718.236565, 'last_price_update_time': 1769630718.236579, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877939') HTTP/1.1" 204 0
2026-01-28 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/3.jpg not downloaded yet
2026-01-28 20:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41e7650>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c455c610>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg saved to cache
2026-01-28 20:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4455650>
2026-01-28 20:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/4.jpg not downloaded yet
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/5.jpg not downloaded yet
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c421b390>
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg saved to cache
2026-01-28 20:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4307310>
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg saved to cache
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/6.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/7.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/8.jpg not downloaded yet
2026-01-28 20:05:20 [ayvens.fr] INFO: Found listing with ID: 1877942
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877942%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [ayvens.fr] INFO: Scrape type for 1877942: 1
2026-01-28 20:05:20 [ayvens.fr] INFO: Extracting data for car ID: 1877942
2026-01-28 20:05:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e8de117-09e7-5a30-b381-b8244238dcdd with identifier: 1877942
2026-01-28 20:05:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8de117-09e7-5a30-b381-b8244238dcdd with scrape type 1
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/1.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/2.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/3.jpg not downloaded yet
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/4.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/5.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/6.jpg not downloaded yet
2026-01-28 20:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/7.jpg not downloaded yet
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/8.jpg not downloaded yet
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff54f90>
2026-01-28 20:05:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e5d90>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:21 [ayvens.fr] INFO: Found listing with ID: 1877943
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877943%27 HTTP/1.1" 200 None
2026-01-28 20:05:21 [ayvens.fr] INFO: Scrape type for 1877943: 1
2026-01-28 20:05:21 [ayvens.fr] INFO: Extracting data for car ID: 1877943
2026-01-28 20:05:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 799fc90d-301c-5ce8-9d8b-cd93a7837911 with identifier: 1877943
2026-01-28 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799fc90d-301c-5ce8-9d8b-cd93a7837911 with scrape type 1
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/1.jpg not downloaded yet
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/2.jpg not downloaded yet
2026-01-28 20:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/3.jpg not downloaded yet
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d3d90>
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252Fad590387e2c146649b6e0d4395628ed3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg saved to cache
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6d1d55c5-7ccc-5e39-a428-7430f2848324
2026-01-28 20:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6d1d55c5-7ccc-5e39-a428-7430f2848324, skipping ID generation
2026-01-28 20:05:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d1d55c5-7ccc-5e39-a428-7430f2848324 with scrape type 1
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6d1d55c5-7ccc-5e39-a428-7430f2848324 from tracking dictionaries
2026-01-28 20:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6d1d55c5-7ccc-5e39-a428-7430f2848324 sending to next pipeline
2026-01-28 20:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6d1d55c5-7ccc-5e39-a428-7430f2848324, identifier: 1877940
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6d1d55c5-7ccc-5e39-a428-7430f2848324 with identifier: 1877940
2026-01-28 20:05:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6d1d55c5-7ccc-5e39-a428-7430f2848324 with identifier: 1877940
2026-01-28 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris amazonite', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '3008', 'trim': '3008 1.2 puretech 130ch s&s active business eat8', 'title': 'peugeot 3008 3008 1.2 puretech 130ch s&s active business eat8', 'price': 0, 'odometer': 95097, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-18', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 152, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '6d1d55c5-7ccc-5e39-a428-7430f2848324', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 476500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 476500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 444671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 419892}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 369670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 376460}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 289066}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 309836}], 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 95097}
Failed validating None in schema:
False
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'gris amazonite',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '6d1d55c5-7ccc-5e39-a428-7430f2848324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 95097,
'odometer_in_km': 95097,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444671,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-18',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 3008 1.2 puretech 130ch s&s active business '
'eat8',
'transmission': 'automatic',
'trim': '3008 1.2 puretech 130ch s&s active business eat8',
'vin': None,
'year': 2020}
2026-01-28 20:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 6d1d55c5-7ccc-5e39-a428-7430f2848324 spider: ayvens.fr
2026-01-28 20:05:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6d1d55c5-7ccc-5e39-a428-7430f2848324 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris amazonite', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '3008', 'trim': '3008 1.2 puretech 130ch s&s active business eat8', 'title': 'peugeot 3008 3008 1.2 puretech 130ch s&s active business eat8', 'price': 0, 'odometer': 95097, 'odometer_reading_unit': 'km', 'registration_date': '2020-09-18', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 152, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '6d1d55c5-7ccc-5e39-a428-7430f2848324', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 476500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 476500}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 444671}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 419892}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 369670}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 376460}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 289066}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 309836}], 'current_year_diff': 6, 'age_in_months': 64, 'make_model': 'peugeot 3008', 'sanitized_make': 'peugeot', 'odometer_in_km': 95097}
Failed validating None in schema:
False
On instance:
{'age_in_months': 64,
'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'gris amazonite',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '6d1d55c5-7ccc-5e39-a428-7430f2848324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 3008',
'model': '3008',
'odometer': 95097,
'odometer_in_km': 95097,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444671,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-18',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 3008 3008 1.2 puretech 130ch s&s active business '
'eat8',
'transmission': 'automatic',
'trim': '3008 1.2 puretech 130ch s&s active business eat8',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 152,
'color': 'GRIS AMAZONITE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '6d1d55c5-7ccc-5e39-a428-7430f2848324',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 95097,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 476500,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 444671,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419892,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369670,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376460,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6d1d55c5-7ccc-5e39-a428-7430f2848324/6d1d55c5-7ccc-5e39-a428-7430f2848324_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/ad590387e2c146649b6e0d4395628ed3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-18',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 1.2 PureTech 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '3008 1.2 PureTech 130ch S&S Active Business EAT8',
'vin': None,
'year': 2020}
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877940%27 HTTP/1.1" 200 None
2026-01-28 20:05:22 [ayvens.fr] INFO: Saving data for 1877940: {'created_time': 1769630722.263535, 'last_price_update_time': 1769630722.263546, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877940') HTTP/1.1" 204 0
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/4.jpg not downloaded yet
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/5.jpg not downloaded yet
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4518b90>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/7.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaedd50>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/1.jpg saved to cache
2026-01-28 20:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4297e50>
2026-01-28 20:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/6.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/6.jpg not downloaded yet
2026-01-28 20:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/7.jpg not downloaded yet
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407ec10>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/8.jpg saved to cache
2026-01-28 20:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f89d0>
2026-01-28 20:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/4.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4085490>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/5.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c23d0>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/2.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40862d0>
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffx-%252Fed9eb5bb2be84b978b44d20dc34979fa%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/3.jpg saved to cache
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d19efd59-ecff-5ae3-9308-a7e12bb28a00
2026-01-28 20:05:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d19efd59-ecff-5ae3-9308-a7e12bb28a00, skipping ID generation
2026-01-28 20:05:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d19efd59-ecff-5ae3-9308-a7e12bb28a00 with scrape type 1
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d19efd59-ecff-5ae3-9308-a7e12bb28a00 from tracking dictionaries
2026-01-28 20:05:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d19efd59-ecff-5ae3-9308-a7e12bb28a00 sending to next pipeline
2026-01-28 20:05:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d19efd59-ecff-5ae3-9308-a7e12bb28a00, identifier: 1877941
2026-01-28 20:05:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d19efd59-ecff-5ae3-9308-a7e12bb28a00 with identifier: 1877941
2026-01-28 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d19efd59-ecff-5ae3-9308-a7e12bb28a00 with identifier: 1877941
2026-01-28 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:05:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: d19efd59-ecff-5ae3-9308-a7e12bb28a00 spider: ayvens.fr
2026-01-28 20:05:25 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: d19efd59-ecff-5ae3-9308-a7e12bb28a00 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd19efd59-ecff-5ae3-9308-a7e12bb28a00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 112957,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398537,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 334646,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293679,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315880,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d19efd59-ecff-5ae3-9308-a7e12bb28a00/d19efd59-ecff-5ae3-9308-a7e12bb28a00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352767,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fx-/ed9eb5bb2be84b978b44d20dc34979fa/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-03-08',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2021}
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877941%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [ayvens.fr] INFO: Saving data for 1877941: {'created_time': 1769630725.324574, 'last_price_update_time': 1769630725.324587, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877941') HTTP/1.1" 204 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/8.jpg not downloaded yet
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425f810>
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/1.jpg saved to cache
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [ayvens.fr] INFO: Found listing with ID: 1877944
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877944%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [ayvens.fr] INFO: Scrape type for 1877944: 1
2026-01-28 20:05:25 [ayvens.fr] INFO: Extracting data for car ID: 1877944
2026-01-28 20:05:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 with identifier: 1877944
2026-01-28 20:05:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 with scrape type 1
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg not downloaded yet
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg not downloaded yet
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4305b50>
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/3.jpg saved to cache
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454cdd0>
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/2.jpg saved to cache
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg not downloaded yet
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg not downloaded yet
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e1fd0>
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/4.jpg saved to cache
2026-01-28 20:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41fa950>
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/2.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4519cd0>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/7.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b5010>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/6.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg not downloaded yet
2026-01-28 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg not downloaded yet
2026-01-28 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg not downloaded yet
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4348050>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/5.jpg saved to cache
2026-01-28 20:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c434af50>
2026-01-28 20:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Fa4f1c68f13124f7ab4d795792d170430%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/8.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4e8de117-09e7-5a30-b381-b8244238dcdd
2026-01-28 20:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e8de117-09e7-5a30-b381-b8244238dcdd, skipping ID generation
2026-01-28 20:05:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e8de117-09e7-5a30-b381-b8244238dcdd with scrape type 1
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4e8de117-09e7-5a30-b381-b8244238dcdd from tracking dictionaries
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e8de117-09e7-5a30-b381-b8244238dcdd sending to next pipeline
2026-01-28 20:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4e8de117-09e7-5a30-b381-b8244238dcdd, identifier: 1877942
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [scrapy.extensions.logstats] INFO: Crawled 13 pages (at 4 pages/min), scraped 28 items (at 7 items/min)
2026-01-28 20:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4e8de117-09e7-5a30-b381-b8244238dcdd with identifier: 1877942
2026-01-28 20:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4e8de117-09e7-5a30-b381-b8244238dcdd with identifier: 1877942
2026-01-28 20:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
2026-01-28 20:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 4e8de117-09e7-5a30-b381-b8244238dcdd spider: ayvens.fr
2026-01-28 20:05:28 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 4e8de117-09e7-5a30-b381-b8244238dcdd due to rule: makes_models_not_allowed.json, error: Rejected due to make 'toyota' containing 'toyota' and model 'proace city' containing 'proace'
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '4e8de117-09e7-5a30-b381-b8244238dcdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'PROACE CITY',
'odometer': 64823,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296938,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282497,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376798,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e8de117-09e7-5a30-b381-b8244238dcdd/4e8de117-09e7-5a30-b381-b8244238dcdd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385186,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/a4f1c68f13124f7ab4d795792d170430/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-07',
'seats_number': 3,
'seller_name': None,
'title': 'TOYOTA PROACE CITY PROACE CITY Medium 100 D-4D Business',
'transmission': 'manual',
'trim': 'PROACE CITY Medium 100 D-4D Business',
'vin': None,
'year': 2022}
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877942%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [ayvens.fr] INFO: Saving data for 1877942: {'created_time': 1769630728.56585, 'last_price_update_time': 1769630728.56586, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877942') HTTP/1.1" 204 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg not downloaded yet
2026-01-28 20:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c443f0d0>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/3.jpg saved to cache
2026-01-28 20:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c440f310>
2026-01-28 20:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/4.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c47370d0>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/1.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4736cd0>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/8.jpg saved to cache
2026-01-28 20:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4095450>
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/6.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40ffa90>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/7.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:30 [ayvens.fr] INFO: Found listing with ID: 1877945
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877945%27 HTTP/1.1" 200 None
2026-01-28 20:05:30 [ayvens.fr] INFO: Scrape type for 1877945: 1
2026-01-28 20:05:30 [ayvens.fr] INFO: Extracting data for car ID: 1877945
2026-01-28 20:05:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14de0fed-0fbb-58e6-af5d-1ea6c146c52e with identifier: 1877945
2026-01-28 20:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e with scrape type 1
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/1.jpg not downloaded yet
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4328e50>
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Feba0fcd8aecd458ba197fc03ec2811fe%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/5.jpg saved to cache
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 799fc90d-301c-5ce8-9d8b-cd93a7837911
2026-01-28 20:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 799fc90d-301c-5ce8-9d8b-cd93a7837911, skipping ID generation
2026-01-28 20:05:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 799fc90d-301c-5ce8-9d8b-cd93a7837911 with scrape type 1
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 799fc90d-301c-5ce8-9d8b-cd93a7837911 from tracking dictionaries
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 799fc90d-301c-5ce8-9d8b-cd93a7837911 sending to next pipeline
2026-01-28 20:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 799fc90d-301c-5ce8-9d8b-cd93a7837911, identifier: 1877943
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/2.jpg not downloaded yet
2026-01-28 20:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 799fc90d-301c-5ce8-9d8b-cd93a7837911 with identifier: 1877943
2026-01-28 20:05:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 799fc90d-301c-5ce8-9d8b-cd93a7837911 with identifier: 1877943
2026-01-28 20:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 799fc90d-301c-5ce8-9d8b-cd93a7837911 with identifier: 1877943 to the API
2026-01-28 20:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 47,
'color': 'GRIS PEBBLE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': '799fc90d-301c-5ce8-9d8b-cd93a7837911',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 110484,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365710,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 229535,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_799fc90d-301c-5ce8-9d8b-cd93a7837911/799fc90d-301c-5ce8-9d8b-cd93a7837911_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/eba0fcd8aecd458ba197fc03ec2811fe/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T5 Recharge 180 + 82ch Plus DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T5 Recharge 180 + 82ch Plus DCT 7',
'vin': None,
'year': 2022}
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877943%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [ayvens.fr] INFO: Saving data for 1877943: {'created_time': 1769630731.44197, 'last_price_update_time': 1769630731.441984, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877943') HTTP/1.1" 204 0
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a6c90>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg saved to cache
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/3.jpg not downloaded yet
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/4.jpg not downloaded yet
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/5.jpg not downloaded yet
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/6.jpg not downloaded yet
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/7.jpg not downloaded yet
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/8.jpg not downloaded yet
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff36f90>
2026-01-28 20:05:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4143110>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:32 [ayvens.fr] INFO: Found listing with ID: 1877946
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877946%27 HTTP/1.1" 200 None
2026-01-28 20:05:32 [ayvens.fr] INFO: Scrape type for 1877946: 1
2026-01-28 20:05:32 [ayvens.fr] INFO: Extracting data for car ID: 1877946
2026-01-28 20:05:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 296e97ff-9c66-5ddd-a601-2c413807ae52 with identifier: 1877946
2026-01-28 20:05:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296e97ff-9c66-5ddd-a601-2c413807ae52 with scrape type 1
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/1.jpg not downloaded yet
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425ecd0>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg saved to cache
2026-01-28 20:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452a310>
2026-01-28 20:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff29c10>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/2.jpg not downloaded yet
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40c84d0>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg saved to cache
2026-01-28 20:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d39d0>
2026-01-28 20:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fc37e59a31817455583338eeb922023b5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg saved to cache
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8
2026-01-28 20:05:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8, skipping ID generation
2026-01-28 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 with scrape type 1
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 from tracking dictionaries
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 sending to next pipeline
2026-01-28 20:05:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8, identifier: 1877944
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/3.jpg not downloaded yet
2026-01-28 20:05:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 with identifier: 1877944
2026-01-28 20:05:34 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 with identifier: 1877944
2026-01-28 20:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'vert aventurine', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'kia', 'model': 'niro ev', 'trim': 'niro ev 204ch active business', 'title': 'kia niro ev niro ev 204ch active business', 'price': 0, 'odometer': 65549, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-23', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.2l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '424164e2-cbf0-5e3e-86aa-6f49d431bbb8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 477024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 357482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312387}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339369}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 330106}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 230507}], 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'kia niro ev', 'sanitized_make': 'kia', 'odometer_in_km': 65549} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 31,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'vert aventurine',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.2l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '424164e2-cbf0-5e3e-86aa-6f49d431bbb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'kia',
'make_model': 'kia niro ev',
'model': 'niro ev',
'odometer': 65549,
'odometer_in_km': 65549,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-23',
'sanitized_make': 'kia',
'seats_number': 5,
'seller_name': None,
'title': 'kia niro ev niro ev 204ch active business',
'transmission': 'automatic',
'trim': 'niro ev 204ch active business',
'vin': None,
'year': 2023}
2026-01-28 20:05:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 spider: ayvens.fr
2026-01-28 20:05:34 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 424164e2-cbf0-5e3e-86aa-6f49d431bbb8 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'vert aventurine', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'kia', 'model': 'niro ev', 'trim': 'niro ev 204ch active business', 'title': 'kia niro ev niro ev 204ch active business', 'price': 0, 'odometer': 65549, 'odometer_reading_unit': 'km', 'registration_date': '2023-06-23', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.2l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '424164e2-cbf0-5e3e-86aa-6f49d431bbb8', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 411270}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 477024}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 357482}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312387}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339369}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 330106}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 230507}], 'current_year_diff': 3, 'age_in_months': 31, 'make_model': 'kia niro ev', 'sanitized_make': 'kia', 'odometer_in_km': 65549} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 31,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'vert aventurine',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.2l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '424164e2-cbf0-5e3e-86aa-6f49d431bbb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'kia',
'make_model': 'kia niro ev',
'model': 'niro ev',
'odometer': 65549,
'odometer_in_km': 65549,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-23',
'sanitized_make': 'kia',
'seats_number': 5,
'seller_name': None,
'title': 'kia niro ev niro ev 204ch active business',
'transmission': 'automatic',
'trim': 'niro ev 204ch active business',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'VERT AVENTURINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': '424164e2-cbf0-5e3e-86aa-6f49d431bbb8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 65549,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 411270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 477024,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312387,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339369,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_424164e2-cbf0-5e3e-86aa-6f49d431bbb8/424164e2-cbf0-5e3e-86aa-6f49d431bbb8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/c37e59a31817455583338eeb922023b5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Active Business',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Active Business',
'vin': None,
'year': 2023}
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877944%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [ayvens.fr] INFO: Saving data for 1877944: {'created_time': 1769630734.586925, 'last_price_update_time': 1769630734.586937, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877944') HTTP/1.1" 204 0
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/4.jpg not downloaded yet
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/5.jpg not downloaded yet
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/6.jpg not downloaded yet
2026-01-28 20:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/7.jpg not downloaded yet
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/8.jpg not downloaded yet
2026-01-28 20:05:34 [ayvens.fr] INFO: Found listing with ID: 1877947
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877947%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [ayvens.fr] INFO: Scrape type for 1877947: 1
2026-01-28 20:05:34 [ayvens.fr] INFO: Extracting data for car ID: 1877947
2026-01-28 20:05:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c with identifier: 1877947
2026-01-28 20:05:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c with scrape type 1
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/1.jpg not downloaded yet
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c470db50>
2026-01-28 20:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/6.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfac1ad0>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/4.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4294b50>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/5.jpg saved to cache
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/2.jpg not downloaded yet
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/3.jpg not downloaded yet
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4283d90>
2026-01-28 20:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/3.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42829d0>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/7.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45467d0>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/2.jpg saved to cache
2026-01-28 20:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4280850>
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/1.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4382cd0>
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252Fcf08316857f24a4e8bc2dd3e23c3d482%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/8.jpg saved to cache
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e
2026-01-28 20:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14de0fed-0fbb-58e6-af5d-1ea6c146c52e, skipping ID generation
2026-01-28 20:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e with scrape type 1
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e from tracking dictionaries
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14de0fed-0fbb-58e6-af5d-1ea6c146c52e sending to next pipeline
2026-01-28 20:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 14de0fed-0fbb-58e6-af5d-1ea6c146c52e, identifier: 1877945
2026-01-28 20:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 14de0fed-0fbb-58e6-af5d-1ea6c146c52e with identifier: 1877945
2026-01-28 20:05:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 14de0fed-0fbb-58e6-af5d-1ea6c146c52e with identifier: 1877945
2026-01-28 20:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 14de0fed-0fbb-58e6-af5d-1ea6c146c52e with identifier: 1877945 to the API
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 115,
'color': 'GRIS LUNAIRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '14de0fed-0fbb-58e6-af5d-1ea6c146c52e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'FIESTA',
'odometer': 47379,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496522,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431576,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308835,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273743,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14de0fed-0fbb-58e6-af5d-1ea6c146c52e/14de0fed-0fbb-58e6-af5d-1ea6c146c52e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 419066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/cf08316857f24a4e8bc2dd3e23c3d482/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-13',
'seats_number': 5,
'seller_name': None,
'title': 'FORD FIESTA Fiesta 1.0 EcoBoost 95ch Connect Business',
'transmission': 'manual',
'trim': 'Fiesta 1.0 EcoBoost 95ch Connect Business',
'vin': None,
'year': 2020}
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877945%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [ayvens.fr] INFO: Saving data for 1877945: {'created_time': 1769630737.818437, 'last_price_update_time': 1769630737.818448, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877945') HTTP/1.1" 204 0
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/4.jpg not downloaded yet
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/5.jpg not downloaded yet
2026-01-28 20:05:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/6.jpg not downloaded yet
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/7.jpg not downloaded yet
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/8.jpg not downloaded yet
2026-01-28 20:05:37 [ayvens.fr] INFO: Found listing with ID: 1877948
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877948%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [ayvens.fr] INFO: Scrape type for 1877948: 1
2026-01-28 20:05:37 [ayvens.fr] INFO: Extracting data for car ID: 1877948
2026-01-28 20:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 with identifier: 1877948
2026-01-28 20:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 with scrape type 1
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/1.jpg not downloaded yet
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41da090>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/1.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4377850>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/5.jpg saved to cache
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/2.jpg not downloaded yet
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b2790>
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/2.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2b050>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/4.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441a750>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/7.jpg saved to cache
2026-01-28 20:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441a090>
2026-01-28 20:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/6.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44190d0>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/3.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/3.jpg not downloaded yet
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d3010>
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252F6ca96d651be74355be76faaacf7b590e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/8.jpg saved to cache
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 296e97ff-9c66-5ddd-a601-2c413807ae52
2026-01-28 20:05:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 296e97ff-9c66-5ddd-a601-2c413807ae52, skipping ID generation
2026-01-28 20:05:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 296e97ff-9c66-5ddd-a601-2c413807ae52 with scrape type 1
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 296e97ff-9c66-5ddd-a601-2c413807ae52 from tracking dictionaries
2026-01-28 20:05:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 296e97ff-9c66-5ddd-a601-2c413807ae52 sending to next pipeline
2026-01-28 20:05:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 296e97ff-9c66-5ddd-a601-2c413807ae52, identifier: 1877946
2026-01-28 20:05:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 296e97ff-9c66-5ddd-a601-2c413807ae52 with identifier: 1877946
2026-01-28 20:05:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 296e97ff-9c66-5ddd-a601-2c413807ae52 with identifier: 1877946
2026-01-28 20:05:40 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 296e97ff-9c66-5ddd-a601-2c413807ae52 with identifier: 1877946 to the API
2026-01-28 20:05:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 111,
'color': 'BLANC GLACIER',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '296e97ff-9c66-5ddd-a601-2c413807ae52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 47507,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294778,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316686,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_296e97ff-9c66-5ddd-a601-2c413807ae52/296e97ff-9c66-5ddd-a601-2c413807ae52_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 218371,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/6ca96d651be74355be76faaacf7b590e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-25',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.5 Blue dCi 100ch Business',
'transmission': 'manual',
'trim': 'Clio Réversible 1.5 Blue dCi 100ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877946%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [ayvens.fr] INFO: Saving data for 1877946: {'created_time': 1769630742.269798, 'last_price_update_time': 1769630742.269811, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877946') HTTP/1.1" 204 0
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/4.jpg not downloaded yet
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/5.jpg not downloaded yet
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412aa10>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/5.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/6.jpg not downloaded yet
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40853d0>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/4.jpg saved to cache
2026-01-28 20:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4374090>
2026-01-28 20:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/6.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff292d0>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/7.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e7590>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/1.jpg saved to cache
2026-01-28 20:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4154890>
2026-01-28 20:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/3.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414d790>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/2.jpg saved to cache
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/7.jpg not downloaded yet
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/8.jpg not downloaded yet
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4280d50>
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Feb9ef81ad0694906ba0ff1d536364314%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/8.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c
2026-01-28 20:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c, skipping ID generation
2026-01-28 20:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c with scrape type 1
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c from tracking dictionaries
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c sending to next pipeline
2026-01-28 20:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c, identifier: 1877947
2026-01-28 20:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c with identifier: 1877947
2026-01-28 20:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c with identifier: 1877947
2026-01-28 20:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c spider: ayvens.fr
2026-01-28 20:05:45 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 78fe7c8d-511b-5e4f-9a1f-4d42241dd76c due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '78fe7c8d-511b-5e4f-9a1f-4d42241dd76c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 43702,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456725,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 426153,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330052,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260350,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272216,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280916,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_78fe7c8d-511b-5e4f-9a1f-4d42241dd76c/78fe7c8d-511b-5e4f-9a1f-4d42241dd76c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268711,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/eb9ef81ad0694906ba0ff1d536364314/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-16',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Sté 1.0 SCe 65ch Air Nav',
'transmission': 'manual',
'trim': 'Clio Sté 1.0 SCe 65ch Air Nav',
'vin': None,
'year': 2021}
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877947%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [ayvens.fr] INFO: Saving data for 1877947: {'created_time': 1769630745.386976, 'last_price_update_time': 1769630745.386987, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877947') HTTP/1.1" 204 0
2026-01-28 20:05:45 [ayvens.fr] INFO: Found listing with ID: 1877949
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877949%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [ayvens.fr] INFO: Scrape type for 1877949: 1
2026-01-28 20:05:45 [ayvens.fr] INFO: Extracting data for car ID: 1877949
2026-01-28 20:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b3055a0-232f-5a92-b5d4-f07cffcc441f with identifier: 1877949
2026-01-28 20:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f with scrape type 1
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/1.jpg not downloaded yet
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/2.jpg not downloaded yet
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/3.jpg not downloaded yet
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/4.jpg not downloaded yet
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/5.jpg not downloaded yet
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/6.jpg not downloaded yet
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/7.jpg not downloaded yet
2026-01-28 20:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d0d10>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/2.jpg saved to cache
2026-01-28 20:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419c850>
2026-01-28 20:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/1.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c421b4d0>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/4.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff2a550>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/3.jpg saved to cache
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/8.jpg not downloaded yet
2026-01-28 20:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:46 [ayvens.fr] INFO: Found listing with ID: 1877950
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877950%27 HTTP/1.1" 200 None
2026-01-28 20:05:46 [ayvens.fr] INFO: Scrape type for 1877950: 1
2026-01-28 20:05:46 [ayvens.fr] INFO: Extracting data for car ID: 1877950
2026-01-28 20:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4a2cbd0-3419-5c32-80ea-582d79220b27 with identifier: 1877950
2026-01-28 20:05:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a2cbd0-3419-5c32-80ea-582d79220b27 with scrape type 1
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/1.jpg not downloaded yet
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d01d0>
2026-01-28 20:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/6.jpg saved to cache
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ce810>
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/5.jpg saved to cache
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4380d50>
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/7.jpg saved to cache
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/2.jpg not downloaded yet
2026-01-28 20:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e3e50>
2026-01-28 20:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252F7d204c9ac5614fda887a1abdf3989dee%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/8.jpg saved to cache
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33
2026-01-28 20:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 05ae240d-c9b5-5cc5-9ab3-769bdf857e33, skipping ID generation
2026-01-28 20:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 with scrape type 1
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 from tracking dictionaries
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 sending to next pipeline
2026-01-28 20:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 05ae240d-c9b5-5cc5-9ab3-769bdf857e33, identifier: 1877948
2026-01-28 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/3.jpg not downloaded yet
2026-01-28 20:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 with identifier: 1877948
2026-01-28 20:05:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 with identifier: 1877948
2026-01-28 20:05:48 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 05ae240d-c9b5-5cc5-9ab3-769bdf857e33 with identifier: 1877948 to the API
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 157,
'color': 'REFLET ARGENT METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '05ae240d-c9b5-5cc5-9ab3-769bdf857e33',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 129491,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488219,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 388250,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369673,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 367659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_05ae240d-c9b5-5cc5-9ab3-769bdf857e33/05ae240d-c9b5-5cc5-9ab3-769bdf857e33_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 227134,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/7d204c9ac5614fda887a1abdf3989dee/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-08-04',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 1.5 TSI 150ch Life Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 1.5 TSI 150ch Life Business DSG7',
'vin': None,
'year': 2022}
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877948%27 HTTP/1.1" 200 None
2026-01-28 20:05:48 [ayvens.fr] INFO: Saving data for 1877948: {'created_time': 1769630748.769641, 'last_price_update_time': 1769630748.769656, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877948') HTTP/1.1" 204 0
2026-01-28 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/4.jpg not downloaded yet
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4257490>
2026-01-28 20:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/1.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4095190>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/4.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cdfd0>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/5.jpg saved to cache
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/5.jpg not downloaded yet
2026-01-28 20:05:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/6.jpg not downloaded yet
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44869d0>
2026-01-28 20:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/2.jpg saved to cache
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c440c110>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/3.jpg saved to cache
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45363d0>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/6.jpg saved to cache
2026-01-28 20:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c406d450>
2026-01-28 20:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/7.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/7.jpg not downloaded yet
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff378d0>
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F19a24b9dcc7d4274a02441b845f82dff%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/8.jpg saved to cache
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f
2026-01-28 20:05:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5b3055a0-232f-5a92-b5d4-f07cffcc441f, skipping ID generation
2026-01-28 20:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f with scrape type 1
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5b3055a0-232f-5a92-b5d4-f07cffcc441f from tracking dictionaries
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5b3055a0-232f-5a92-b5d4-f07cffcc441f sending to next pipeline
2026-01-28 20:05:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5b3055a0-232f-5a92-b5d4-f07cffcc441f, identifier: 1877949
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/8.jpg not downloaded yet
2026-01-28 20:05:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5b3055a0-232f-5a92-b5d4-f07cffcc441f with identifier: 1877949
2026-01-28 20:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5b3055a0-232f-5a92-b5d4-f07cffcc441f with identifier: 1877949
2026-01-28 20:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:05:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 5b3055a0-232f-5a92-b5d4-f07cffcc441f spider: ayvens.fr
2026-01-28 20:05:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 5b3055a0-232f-5a92-b5d4-f07cffcc441f due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5b3055a0-232f-5a92-b5d4-f07cffcc441f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 97702,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 407162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 447678,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329149,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5b3055a0-232f-5a92-b5d4-f07cffcc441f/5b3055a0-232f-5a92-b5d4-f07cffcc441f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 347789,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/19a24b9dcc7d4274a02441b845f82dff/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-26',
'seats_number': 2,
'seller_name': None,
'title': 'RENAULT CLIO Clio Réversible 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio Réversible 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2021}
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877949%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [ayvens.fr] INFO: Saving data for 1877949: {'created_time': 1769630751.869043, 'last_price_update_time': 1769630751.869054, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877949') HTTP/1.1" 204 0
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:51 [ayvens.fr] INFO: Found listing with ID: 1877951
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877951%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [ayvens.fr] INFO: Scrape type for 1877951: 1
2026-01-28 20:05:51 [ayvens.fr] INFO: Extracting data for car ID: 1877951
2026-01-28 20:05:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb with identifier: 1877951
2026-01-28 20:05:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb with scrape type 1
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/1.jpg not downloaded yet
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/2.jpg not downloaded yet
2026-01-28 20:05:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/3.jpg not downloaded yet
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/4.jpg not downloaded yet
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/5.jpg not downloaded yet
2026-01-28 20:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/6.jpg not downloaded yet
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e46d0>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/1.jpg saved to cache
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff78d50>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/2.jpg saved to cache
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/7.jpg not downloaded yet
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/8.jpg not downloaded yet
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40da990>
2026-01-28 20:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/4.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407e9d0>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/3.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf165850>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/5.jpg saved to cache
2026-01-28 20:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44b34d0>
2026-01-28 20:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/6.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [ayvens.fr] INFO: Found listing with ID: 1877952
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877952%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [ayvens.fr] INFO: Scrape type for 1877952: 1
2026-01-28 20:05:54 [ayvens.fr] INFO: Extracting data for car ID: 1877952
2026-01-28 20:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca with identifier: 1877952
2026-01-28 20:05:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca with scrape type 1
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/1.jpg not downloaded yet
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/2.jpg not downloaded yet
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/3.jpg not downloaded yet
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/4.jpg not downloaded yet
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45297d0>
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/7.jpg saved to cache
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/5.jpg not downloaded yet
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/6.jpg not downloaded yet
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4584710>
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/1.jpg saved to cache
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4705b10>
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgf-%252Feaac06b6211243c6b1dd332a1e7d568c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/8.jpg saved to cache
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4a2cbd0-3419-5c32-80ea-582d79220b27
2026-01-28 20:05:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4a2cbd0-3419-5c32-80ea-582d79220b27, skipping ID generation
2026-01-28 20:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4a2cbd0-3419-5c32-80ea-582d79220b27 with scrape type 1
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f4a2cbd0-3419-5c32-80ea-582d79220b27 from tracking dictionaries
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4a2cbd0-3419-5c32-80ea-582d79220b27 sending to next pipeline
2026-01-28 20:05:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f4a2cbd0-3419-5c32-80ea-582d79220b27, identifier: 1877950
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c440c290>
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/4.jpg saved to cache
2026-01-28 20:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40da010>
2026-01-28 20:05:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:05:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/2.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b8a50>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/3.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf143a90>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/6.jpg saved to cache
2026-01-28 20:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40f50d0>
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/5.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f4a2cbd0-3419-5c32-80ea-582d79220b27 with identifier: 1877950
2026-01-28 20:05:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f4a2cbd0-3419-5c32-80ea-582d79220b27 with identifier: 1877950
2026-01-28 20:05:57 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f4a2cbd0-3419-5c32-80ea-582d79220b27 with identifier: 1877950 to the API
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 98,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'f4a2cbd0-3419-5c32-80ea-582d79220b27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 78035,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433613,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432106,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376825,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287317,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4a2cbd0-3419-5c32-80ea-582d79220b27/f4a2cbd0-3419-5c32-80ea-582d79220b27_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344584,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gf-/eaac06b6211243c6b1dd332a1e7d568c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-03-11',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech hybride 140ch Business',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech hybride 140ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877950%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [ayvens.fr] INFO: Saving data for 1877950: {'created_time': 1769630757.573587, 'last_price_update_time': 1769630757.573597, 'auction_closing_time': 1769695200.0}
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877950') HTTP/1.1" 204 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/7.jpg not downloaded yet
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/8.jpg not downloaded yet
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a4f10>
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/8.jpg saved to cache
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [ayvens.fr] INFO: Found listing with ID: 1877953
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877953%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [ayvens.fr] INFO: Scrape type for 1877953: 1
2026-01-28 20:05:57 [ayvens.fr] INFO: Extracting data for car ID: 1877953
2026-01-28 20:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b7bab8-a4f3-573a-b121-62f7f33798e5 with identifier: 1877953
2026-01-28 20:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b7bab8-a4f3-573a-b121-62f7f33798e5 with scrape type 1
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg not downloaded yet
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg not downloaded yet
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg not downloaded yet
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg not downloaded yet
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg not downloaded yet
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c440edd0>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252Fccdaa52244ed4e5a841d5cbf2593aaca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/7.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb
2026-01-28 20:05:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb, skipping ID generation
2026-01-28 20:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb with scrape type 1
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb from tracking dictionaries
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb sending to next pipeline
2026-01-28 20:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb, identifier: 1877951
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfafe190>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/1.jpg saved to cache
2026-01-28 20:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46b7a90>
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/2.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45aa610>
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/4.jpg saved to cache
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg not downloaded yet
2026-01-28 20:05:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb with identifier: 1877951
2026-01-28 20:05:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:05:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb with identifier: 1877951
2026-01-28 20:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb with identifier: 1877951 to the API
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'd7cb1a88-a835-5d1f-8ac0-aeb9717eddbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 12204,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 357750,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 381421,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317913,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291499,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 483148,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb/d7cb1a88-a835-5d1f-8ac0-aeb9717eddbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193094,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/ccdaa52244ed4e5a841d5cbf2593aaca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-01',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877951%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [ayvens.fr] INFO: Saving data for 1877951: {'created_time': 1769630760.760182, 'last_price_update_time': 1769630760.760194, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877951') HTTP/1.1" 204 0
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg not downloaded yet
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4465ad0>
2026-01-28 20:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/3.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42be1d0>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/5.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff7ae10>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/6.jpg saved to cache
2026-01-28 20:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b5190>
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/7.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg not downloaded yet
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [ayvens.fr] INFO: Found listing with ID: 1877954
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877954%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [ayvens.fr] INFO: Scrape type for 1877954: 1
2026-01-28 20:06:02 [ayvens.fr] INFO: Extracting data for car ID: 1877954
2026-01-28 20:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af85f095-5e33-5b15-a037-fd62ff566bdd with identifier: 1877954
2026-01-28 20:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af85f095-5e33-5b15-a037-fd62ff566bdd with scrape type 1
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/1.jpg not downloaded yet
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/2.jpg not downloaded yet
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/3.jpg not downloaded yet
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4087890>
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffz-%252F80eab06ba64842f5b66b907d1d3058cf%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/8.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca
2026-01-28 20:06:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca, skipping ID generation
2026-01-28 20:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca with scrape type 1
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Removing item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca from tracking dictionaries
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca sending to next pipeline
2026-01-28 20:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca, identifier: 1877952
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4157e50>
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg saved to cache
2026-01-28 20:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/4.jpg not downloaded yet
2026-01-28 20:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca with identifier: 1877952
2026-01-28 20:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca with identifier: 1877952
2026-01-28 20:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca with identifier: 1877952 to the API
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 123,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '308',
'odometer': 71097,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 503868,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 484226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320215,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 391605,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182589,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca/abe479d9-56c8-5b8b-8e19-85c2cd4bb2ca_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fz-/80eab06ba64842f5b66b907d1d3058cf/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-05-05',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 308 308 1.5 BlueHDi 130ch S&S Active Business EAT8',
'transmission': 'automatic',
'trim': '308 1.5 BlueHDi 130ch S&S Active Business EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877952%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [ayvens.fr] INFO: Saving data for 1877952: {'created_time': 1769630763.385717, 'last_price_update_time': 1769630763.385727, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877952') HTTP/1.1" 204 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/5.jpg not downloaded yet
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42825d0>
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg saved to cache
2026-01-28 20:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4518190>
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg saved to cache
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c3e90>
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg saved to cache
2026-01-28 20:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4321d10>
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/6.jpg not downloaded yet
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/7.jpg not downloaded yet
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/8.jpg not downloaded yet
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:05 [ayvens.fr] INFO: Found listing with ID: 1877955
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877955%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [ayvens.fr] INFO: Scrape type for 1877955: 1
2026-01-28 20:06:05 [ayvens.fr] INFO: Extracting data for car ID: 1877955
2026-01-28 20:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 with identifier: 1877955
2026-01-28 20:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 with scrape type 1
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/1.jpg not downloaded yet
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/2.jpg not downloaded yet
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4392b10>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435d790>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg saved to cache
2026-01-28 20:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ec0d0>
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252Fec0ce64a40d142358895a7c09c951cf5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg saved to cache
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 52b7bab8-a4f3-573a-b121-62f7f33798e5
2026-01-28 20:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 52b7bab8-a4f3-573a-b121-62f7f33798e5, skipping ID generation
2026-01-28 20:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b7bab8-a4f3-573a-b121-62f7f33798e5 with scrape type 1
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 52b7bab8-a4f3-573a-b121-62f7f33798e5 from tracking dictionaries
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 52b7bab8-a4f3-573a-b121-62f7f33798e5 sending to next pipeline
2026-01-28 20:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 52b7bab8-a4f3-573a-b121-62f7f33798e5, identifier: 1877953
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff159d0>
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/1.jpg saved to cache
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/3.jpg not downloaded yet
2026-01-28 20:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 52b7bab8-a4f3-573a-b121-62f7f33798e5 with identifier: 1877953
2026-01-28 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 52b7bab8-a4f3-573a-b121-62f7f33798e5 with identifier: 1877953
2026-01-28 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 75ch s&s active business', 'title': 'peugeot 208 208 1.2 puretech 75ch s&s active business', 'price': 0, 'odometer': 49009, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-03', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 93, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '52b7bab8-a4f3-573a-b121-62f7f33798e5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 504774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 504774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346098}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 284284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 315103}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 287538}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 337329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 374025}], 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 49009}
Failed validating None in schema:
False
On instance:
{'age_in_months': 67,
'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '52b7bab8-a4f3-573a-b121-62f7f33798e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 49009,
'odometer_in_km': 49009,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-03',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 75ch s&s active business',
'transmission': 'manual',
'trim': '208 1.2 puretech 75ch s&s active business',
'vin': None,
'year': 2020}
2026-01-28 20:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 52b7bab8-a4f3-573a-b121-62f7f33798e5 spider: ayvens.fr
2026-01-28 20:06:06 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 52b7bab8-a4f3-573a-b121-62f7f33798e5 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris artense', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 75ch s&s active business', 'title': 'peugeot 208 208 1.2 puretech 75ch s&s active business', 'price': 0, 'odometer': 49009, 'odometer_reading_unit': 'km', 'registration_date': '2020-06-03', 'year': 2020, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 93, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '52b7bab8-a4f3-573a-b121-62f7f33798e5', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 504774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 504774}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346098}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 284284}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 315103}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 287538}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 337329}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 374025}], 'current_year_diff': 6, 'age_in_months': 67, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 49009}
Failed validating None in schema:
False
On instance:
{'age_in_months': 67,
'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'gris artense',
'currency': 'eur',
'current_year_diff': 6,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '52b7bab8-a4f3-573a-b121-62f7f33798e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 49009,
'odometer_in_km': 49009,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-03',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 75ch s&s active business',
'transmission': 'manual',
'trim': '208 1.2 puretech 75ch s&s active business',
'vin': None,
'year': 2020}
{'auction_title': '',
'c_o_2_emission_value': 93,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '52b7bab8-a4f3-573a-b121-62f7f33798e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 49009,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504774,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346098,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284284,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315103,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337329,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_52b7bab8-a4f3-573a-b121-62f7f33798e5/52b7bab8-a4f3-573a-b121-62f7f33798e5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/ec0ce64a40d142358895a7c09c951cf5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-03',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 75ch S&S Active Business',
'transmission': 'manual',
'trim': '208 1.2 PureTech 75ch S&S Active Business',
'vin': None,
'year': 2020}
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877953%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [ayvens.fr] INFO: Saving data for 1877953: {'created_time': 1769630766.781989, 'last_price_update_time': 1769630766.782002, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877953') HTTP/1.1" 204 0
2026-01-28 20:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/4.jpg not downloaded yet
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43830d0>
2026-01-28 20:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/2.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41fae50>
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/3.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/5.jpg not downloaded yet
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4328650>
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/6.jpg saved to cache
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/6.jpg not downloaded yet
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/7.jpg not downloaded yet
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c1510>
2026-01-28 20:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/4.jpg saved to cache
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4381d50>
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/8.jpg saved to cache
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4157e50>
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/7.jpg saved to cache
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/8.jpg not downloaded yet
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45aaed0>
2026-01-28 20:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F102bd0c214eb453b99f219001534154a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/5.jpg saved to cache
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af85f095-5e33-5b15-a037-fd62ff566bdd
2026-01-28 20:06:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af85f095-5e33-5b15-a037-fd62ff566bdd, skipping ID generation
2026-01-28 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af85f095-5e33-5b15-a037-fd62ff566bdd with scrape type 1
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Removing item af85f095-5e33-5b15-a037-fd62ff566bdd from tracking dictionaries
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af85f095-5e33-5b15-a037-fd62ff566bdd sending to next pipeline
2026-01-28 20:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: af85f095-5e33-5b15-a037-fd62ff566bdd, identifier: 1877954
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [ayvens.fr] INFO: Found listing with ID: 1877956
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877956%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [ayvens.fr] INFO: Scrape type for 1877956: 1
2026-01-28 20:06:09 [ayvens.fr] INFO: Extracting data for car ID: 1877956
2026-01-28 20:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56e658cb-e8f1-5f29-9711-2709afec2135 with identifier: 1877956
2026-01-28 20:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e658cb-e8f1-5f29-9711-2709afec2135 with scrape type 1
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/1.jpg not downloaded yet
2026-01-28 20:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: af85f095-5e33-5b15-a037-fd62ff566bdd with identifier: 1877954
2026-01-28 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: af85f095-5e33-5b15-a037-fd62ff566bdd with identifier: 1877954
2026-01-28 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: af85f095-5e33-5b15-a037-fd62ff566bdd spider: ayvens.fr
2026-01-28 20:06:09 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: af85f095-5e33-5b15-a037-fd62ff566bdd due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'af85f095-5e33-5b15-a037-fd62ff566bdd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 113763,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387128,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353765,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343879,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305797,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303270,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af85f095-5e33-5b15-a037-fd62ff566bdd/af85f095-5e33-5b15-a037-fd62ff566bdd_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 269677,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/102bd0c214eb453b99f219001534154a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877954%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [ayvens.fr] INFO: Saving data for 1877954: {'created_time': 1769630769.556998, 'last_price_update_time': 1769630769.55701, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877954') HTTP/1.1" 204 0
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/2.jpg not downloaded yet
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41e5950>
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/1.jpg saved to cache
2026-01-28 20:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c405ad50>
2026-01-28 20:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/2.jpg saved to cache
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c405b190>
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/3.jpg saved to cache
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/3.jpg not downloaded yet
2026-01-28 20:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/4.jpg not downloaded yet
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf144390>
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/4.jpg saved to cache
2026-01-28 20:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f8a50>
2026-01-28 20:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/5.jpg saved to cache
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/5.jpg not downloaded yet
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4219490>
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/6.jpg saved to cache
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff34910>
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/7.jpg saved to cache
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/6.jpg not downloaded yet
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/7.jpg not downloaded yet
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/8.jpg not downloaded yet
2026-01-28 20:06:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:11 [ayvens.fr] INFO: Found listing with ID: 1877957
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877957%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [ayvens.fr] INFO: Scrape type for 1877957: 1
2026-01-28 20:06:11 [ayvens.fr] INFO: Extracting data for car ID: 1877957
2026-01-28 20:06:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76240161-2468-59b7-8878-a47ed11c5c42 with identifier: 1877957
2026-01-28 20:06:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76240161-2468-59b7-8878-a47ed11c5c42 with scrape type 1
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/1.jpg not downloaded yet
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/2.jpg not downloaded yet
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/3.jpg not downloaded yet
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/4.jpg not downloaded yet
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4233790>
2026-01-28 20:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffs-%252F33f12da02274415cae414bef5b1c3130%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/8.jpg saved to cache
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637
2026-01-28 20:06:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 410d3ee8-b4da-5ee8-80f9-a3ba75f79637, skipping ID generation
2026-01-28 20:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 with scrape type 1
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 from tracking dictionaries
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 sending to next pipeline
2026-01-28 20:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 410d3ee8-b4da-5ee8-80f9-a3ba75f79637, identifier: 1877955
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/5.jpg not downloaded yet
2026-01-28 20:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 with identifier: 1877955
2026-01-28 20:06:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 with identifier: 1877955
2026-01-28 20:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 410d3ee8-b4da-5ee8-80f9-a3ba75f79637 with identifier: 1877955 to the API
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 135,
'color': 'NOIR DIAMANT',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '410d3ee8-b4da-5ee8-80f9-a3ba75f79637',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'OPEL',
'model': 'GRANDLAND X',
'odometer': 90660,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446490,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376054,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 331279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 366137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306866,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293042,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_410d3ee8-b4da-5ee8-80f9-a3ba75f79637/410d3ee8-b4da-5ee8-80f9-a3ba75f79637_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 401665,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fs-/33f12da02274415cae414bef5b1c3130/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-09-21',
'seats_number': 5,
'seller_name': None,
'title': 'OPEL GRANDLAND X Grandland X 1.5 D 130ch Edition Business BVA8',
'transmission': 'automatic',
'trim': 'Grandland X 1.5 D 130ch Edition Business BVA8',
'vin': None,
'year': 2020}
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877955%27 HTTP/1.1" 200 None
2026-01-28 20:06:12 [ayvens.fr] INFO: Saving data for 1877955: {'created_time': 1769630772.772467, 'last_price_update_time': 1769630772.77248, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877955') HTTP/1.1" 204 0
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4230fd0>
2026-01-28 20:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/2.jpg saved to cache
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b6710>
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/1.jpg saved to cache
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/6.jpg not downloaded yet
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c3450>
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/3.jpg saved to cache
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/7.jpg not downloaded yet
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4306790>
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/4.jpg saved to cache
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d13d0>
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/5.jpg saved to cache
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/8.jpg not downloaded yet
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41faf50>
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/6.jpg saved to cache
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:14 [ayvens.fr] INFO: Found listing with ID: 1877958
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877958%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [ayvens.fr] INFO: Scrape type for 1877958: 1
2026-01-28 20:06:14 [ayvens.fr] INFO: Extracting data for car ID: 1877958
2026-01-28 20:06:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f532097f-319f-59c2-9586-42c9531add31 with identifier: 1877958
2026-01-28 20:06:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f532097f-319f-59c2-9586-42c9531add31 with scrape type 1
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/1.jpg not downloaded yet
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/2.jpg not downloaded yet
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418d4d0>
2026-01-28 20:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/1.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452a410>
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/8.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452a7d0>
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/2.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff29090>
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fft-%252F1d41ec2f09f94bfc85caf35ba83e8195%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/7.jpg saved to cache
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 56e658cb-e8f1-5f29-9711-2709afec2135
2026-01-28 20:06:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 56e658cb-e8f1-5f29-9711-2709afec2135, skipping ID generation
2026-01-28 20:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56e658cb-e8f1-5f29-9711-2709afec2135 with scrape type 1
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 56e658cb-e8f1-5f29-9711-2709afec2135 from tracking dictionaries
2026-01-28 20:06:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 56e658cb-e8f1-5f29-9711-2709afec2135 sending to next pipeline
2026-01-28 20:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 56e658cb-e8f1-5f29-9711-2709afec2135, identifier: 1877956
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4307610>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/3.jpg saved to cache
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/3.jpg not downloaded yet
2026-01-28 20:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 56e658cb-e8f1-5f29-9711-2709afec2135 with identifier: 1877956
2026-01-28 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 56e658cb-e8f1-5f29-9711-2709afec2135 with identifier: 1877956
2026-01-28 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-28 20:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 56e658cb-e8f1-5f29-9711-2709afec2135 spider: ayvens.fr
2026-01-28 20:06:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 56e658cb-e8f1-5f29-9711-2709afec2135 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
'c_o_2_emission_value': 229,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '56e658cb-e8f1-5f29-9711-2709afec2135',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'BOXER',
'odometer': 99274,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392242,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380987,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326084,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397141,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_56e658cb-e8f1-5f29-9711-2709afec2135/56e658cb-e8f1-5f29-9711-2709afec2135_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ft-/1d41ec2f09f94bfc85caf35ba83e8195/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-10-26',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT BOXER Boxer Fg 333 L1H1 2.2 BlueHDi S&S 140ch Asphalt',
'transmission': 'manual',
'trim': 'Boxer Fg 333 L1H1 2.2 BlueHDi S&S 140ch Asphalt',
'vin': None,
'year': 2020}
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877956%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [ayvens.fr] INFO: Saving data for 1877956: {'created_time': 1769630776.742067, 'last_price_update_time': 1769630776.74208, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877956') HTTP/1.1" 204 0
2026-01-28 20:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/4.jpg not downloaded yet
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417c1d0>
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/4.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4464410>
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/5.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/5.jpg not downloaded yet
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/6.jpg not downloaded yet
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ec350>
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/6.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/7.jpg not downloaded yet
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43172d0>
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/7.jpg saved to cache
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/8.jpg not downloaded yet
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:18 [ayvens.fr] INFO: Found listing with ID: 1877959
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877959%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [ayvens.fr] INFO: Scrape type for 1877959: 1
2026-01-28 20:06:18 [ayvens.fr] INFO: Extracting data for car ID: 1877959
2026-01-28 20:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dd59d7a5-0bb2-57b4-9f51-99915b574898 with identifier: 1877959
2026-01-28 20:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd59d7a5-0bb2-57b4-9f51-99915b574898 with scrape type 1
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/1.jpg not downloaded yet
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cf490>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F0b3b4bf9c79e4584985b88bae6c2f948%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/8.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 76240161-2468-59b7-8878-a47ed11c5c42
2026-01-28 20:06:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76240161-2468-59b7-8878-a47ed11c5c42, skipping ID generation
2026-01-28 20:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76240161-2468-59b7-8878-a47ed11c5c42 with scrape type 1
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 76240161-2468-59b7-8878-a47ed11c5c42 from tracking dictionaries
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76240161-2468-59b7-8878-a47ed11c5c42 sending to next pipeline
2026-01-28 20:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 76240161-2468-59b7-8878-a47ed11c5c42, identifier: 1877957
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417d010>
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/1.jpg saved to cache
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/2.jpg not downloaded yet
2026-01-28 20:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 76240161-2468-59b7-8878-a47ed11c5c42 with identifier: 1877957
2026-01-28 20:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 76240161-2468-59b7-8878-a47ed11c5c42 with identifier: 1877957
2026-01-28 20:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 76240161-2468-59b7-8878-a47ed11c5c42 with identifier: 1877957 to the API
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 105,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '76240161-2468-59b7-8878-a47ed11c5c42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 4162,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365072,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 365072,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384223,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353040,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 288047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 398505,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76240161-2468-59b7-8878-a47ed11c5c42/76240161-2468-59b7-8878-a47ed11c5c42_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 442939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/0b3b4bf9c79e4584985b88bae6c2f948/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-11',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877957%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [ayvens.fr] INFO: Saving data for 1877957: {'created_time': 1769630779.061443, 'last_price_update_time': 1769630779.061454, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877957') HTTP/1.1" 204 0
2026-01-28 20:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/3.jpg not downloaded yet
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45351d0>
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/2.jpg saved to cache
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b2690>
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/4.jpg saved to cache
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4535110>
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/3.jpg saved to cache
2026-01-28 20:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/4.jpg not downloaded yet
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c0c10>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/5.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/5.jpg not downloaded yet
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/6.jpg not downloaded yet
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c434a910>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/7.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/7.jpg not downloaded yet
2026-01-28 20:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/8.jpg not downloaded yet
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4464210>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/6.jpg saved to cache
2026-01-28 20:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4464390>
2026-01-28 20:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F9bdc1ddfd6904eddb0ee53bedb3566c8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/8.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f532097f-319f-59c2-9586-42c9531add31
2026-01-28 20:06:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f532097f-319f-59c2-9586-42c9531add31, skipping ID generation
2026-01-28 20:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f532097f-319f-59c2-9586-42c9531add31 with scrape type 1
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f532097f-319f-59c2-9586-42c9531add31 from tracking dictionaries
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f532097f-319f-59c2-9586-42c9531add31 sending to next pipeline
2026-01-28 20:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f532097f-319f-59c2-9586-42c9531add31, identifier: 1877958
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4485a10>
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/1.jpg saved to cache
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:21 [ayvens.fr] INFO: Found listing with ID: 1877960
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877960%27 HTTP/1.1" 200 None
2026-01-28 20:06:21 [ayvens.fr] INFO: Scrape type for 1877960: 1
2026-01-28 20:06:21 [ayvens.fr] INFO: Extracting data for car ID: 1877960
2026-01-28 20:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b8770e-6a85-5113-afea-f12e191b6135 with identifier: 1877960
2026-01-28 20:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b8770e-6a85-5113-afea-f12e191b6135 with scrape type 1
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/1.jpg not downloaded yet
2026-01-28 20:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f532097f-319f-59c2-9586-42c9531add31 with identifier: 1877958
2026-01-28 20:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f532097f-319f-59c2-9586-42c9531add31 with identifier: 1877958
2026-01-28 20:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f532097f-319f-59c2-9586-42c9531add31 spider: ayvens.fr
2026-01-28 20:06:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: f532097f-319f-59c2-9586-42c9531add31 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 106,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'f532097f-319f-59c2-9586-42c9531add31',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 73123,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386459,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287939,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232081,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 362793,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 278766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f532097f-319f-59c2-9586-42c9531add31/f532097f-319f-59c2-9586-42c9531add31_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348120,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/9bdc1ddfd6904eddb0ee53bedb3566c8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-12-14',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo Van M 1000kg BlueHDi 100 S&S Club',
'transmission': 'manual',
'trim': 'Berlingo Van M 1000kg BlueHDi 100 S&S Club',
'vin': None,
'year': 2020}
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877958%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [ayvens.fr] INFO: Saving data for 1877958: {'created_time': 1769630782.016187, 'last_price_update_time': 1769630782.016197, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877958') HTTP/1.1" 204 0
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/2.jpg not downloaded yet
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4575190>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/2.jpg saved to cache
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/3.jpg not downloaded yet
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/4.jpg not downloaded yet
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4281190>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/3.jpg saved to cache
2026-01-28 20:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c79d0>
2026-01-28 20:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/4.jpg saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/5.jpg not downloaded yet
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/6.jpg not downloaded yet
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40dbdd0>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/6.jpg saved to cache
2026-01-28 20:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1a3b10>
2026-01-28 20:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/5.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c66d0>
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/7.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/7.jpg not downloaded yet
2026-01-28 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/8.jpg not downloaded yet
2026-01-28 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:24 [ayvens.fr] INFO: Found listing with ID: 1877961
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877961%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [ayvens.fr] INFO: Scrape type for 1877961: 1
2026-01-28 20:06:24 [ayvens.fr] INFO: Extracting data for car ID: 1877961
2026-01-28 20:06:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9dc1f426-abc7-5a13-a124-22b8d114c3c7 with identifier: 1877961
2026-01-28 20:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7 with scrape type 1
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/1.jpg not downloaded yet
2026-01-28 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/2.jpg not downloaded yet
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/3.jpg not downloaded yet
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/4.jpg not downloaded yet
2026-01-28 20:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b8fd0>
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F875695f2b7a9422987b777af2ebf3d1f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/8.jpg saved to cache
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dd59d7a5-0bb2-57b4-9f51-99915b574898
2026-01-28 20:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dd59d7a5-0bb2-57b4-9f51-99915b574898, skipping ID generation
2026-01-28 20:06:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dd59d7a5-0bb2-57b4-9f51-99915b574898 with scrape type 1
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dd59d7a5-0bb2-57b4-9f51-99915b574898 from tracking dictionaries
2026-01-28 20:06:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dd59d7a5-0bb2-57b4-9f51-99915b574898 sending to next pipeline
2026-01-28 20:06:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: dd59d7a5-0bb2-57b4-9f51-99915b574898, identifier: 1877959
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/5.jpg not downloaded yet
2026-01-28 20:06:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: dd59d7a5-0bb2-57b4-9f51-99915b574898 with identifier: 1877959
2026-01-28 20:06:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: dd59d7a5-0bb2-57b4-9f51-99915b574898 with identifier: 1877959
2026-01-28 20:06:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: dd59d7a5-0bb2-57b4-9f51-99915b574898 with identifier: 1877959 to the API
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 117,
'color': 'GRIS CLAIR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'dd59d7a5-0bb2-57b4-9f51-99915b574898',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 43226,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 377596,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319226,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 345229,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272655,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291608,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dd59d7a5-0bb2-57b4-9f51-99915b574898/dd59d7a5-0bb2-57b4-9f51-99915b574898_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 455161,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/875695f2b7a9422987b777af2ebf3d1f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-21',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Business',
'vin': None,
'year': 2022}
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877959%27 HTTP/1.1" 200 None
2026-01-28 20:06:25 [ayvens.fr] INFO: Saving data for 1877959: {'created_time': 1769630785.567214, 'last_price_update_time': 1769630785.567226, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877959') HTTP/1.1" 204 0
2026-01-28 20:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b3210>
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/2.jpg saved to cache
2026-01-28 20:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41e5e50>
2026-01-28 20:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/1.jpg saved to cache
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/6.jpg not downloaded yet
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42549d0>
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/4.jpg saved to cache
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41b9b50>
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/3.jpg saved to cache
2026-01-28 20:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4254650>
2026-01-28 20:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/5.jpg saved to cache
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4254510>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/6.jpg saved to cache
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/7.jpg not downloaded yet
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf166850>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/7.jpg saved to cache
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/8.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [ayvens.fr] INFO: Found listing with ID: 1877962
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877962%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [ayvens.fr] INFO: Scrape type for 1877962: 1
2026-01-28 20:06:27 [ayvens.fr] INFO: Extracting data for car ID: 1877962
2026-01-28 20:06:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aea5faef-0a68-575b-abc2-3fbbe4ff2a00 with identifier: 1877962
2026-01-28 20:06:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00 with scrape type 1
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/1.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/2.jpg not downloaded yet
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/3.jpg not downloaded yet
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/4.jpg not downloaded yet
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40da290>
2026-01-28 20:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F4ffeead87a084713869d76ff8bcac727%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/8.jpg saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 71b8770e-6a85-5113-afea-f12e191b6135
2026-01-28 20:06:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 71b8770e-6a85-5113-afea-f12e191b6135, skipping ID generation
2026-01-28 20:06:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b8770e-6a85-5113-afea-f12e191b6135 with scrape type 1
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 71b8770e-6a85-5113-afea-f12e191b6135 from tracking dictionaries
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 71b8770e-6a85-5113-afea-f12e191b6135 sending to next pipeline
2026-01-28 20:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 71b8770e-6a85-5113-afea-f12e191b6135, identifier: 1877960
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4323410>
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/1.jpg saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a4110>
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/2.jpg saved to cache
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:28 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at -4 pages/min), scraped 38 items (at 10 items/min)
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/5.jpg not downloaded yet
2026-01-28 20:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 71b8770e-6a85-5113-afea-f12e191b6135 with identifier: 1877960
2026-01-28 20:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 71b8770e-6a85-5113-afea-f12e191b6135 with identifier: 1877960
2026-01-28 20:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:06:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 71b8770e-6a85-5113-afea-f12e191b6135 spider: ayvens.fr
2026-01-28 20:06:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 71b8770e-6a85-5113-afea-f12e191b6135 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '71b8770e-6a85-5113-afea-f12e191b6135',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 94763,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 492985,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 271474,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287936,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_71b8770e-6a85-5113-afea-f12e191b6135/71b8770e-6a85-5113-afea-f12e191b6135_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/4ffeead87a084713869d76ff8bcac727/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877960%27 HTTP/1.1" 200 None
2026-01-28 20:06:29 [ayvens.fr] INFO: Saving data for 1877960: {'created_time': 1769630789.351829, 'last_price_update_time': 1769630789.351844, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877960') HTTP/1.1" 204 0
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c601b0d0>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/3.jpg saved to cache
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/6.jpg not downloaded yet
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4335c10>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/4.jpg saved to cache
2026-01-28 20:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4335610>
2026-01-28 20:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/5.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/7.jpg not downloaded yet
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/8.jpg not downloaded yet
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [ayvens.fr] INFO: Found listing with ID: 1877963
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877963%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [ayvens.fr] INFO: Scrape type for 1877963: 1
2026-01-28 20:06:30 [ayvens.fr] INFO: Extracting data for car ID: 1877963
2026-01-28 20:06:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 with identifier: 1877963
2026-01-28 20:06:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 with scrape type 1
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/1.jpg not downloaded yet
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/2.jpg not downloaded yet
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c404a6d0>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/6.jpg saved to cache
2026-01-28 20:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41408d0>
2026-01-28 20:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/8.jpg saved to cache
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4049310>
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fde27688e0a31415caedd0ed88e1c999b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/7.jpg saved to cache
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7
2026-01-28 20:06:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9dc1f426-abc7-5a13-a124-22b8d114c3c7, skipping ID generation
2026-01-28 20:06:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7 with scrape type 1
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9dc1f426-abc7-5a13-a124-22b8d114c3c7 from tracking dictionaries
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9dc1f426-abc7-5a13-a124-22b8d114c3c7 sending to next pipeline
2026-01-28 20:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9dc1f426-abc7-5a13-a124-22b8d114c3c7, identifier: 1877961
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/3.jpg not downloaded yet
2026-01-28 20:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9dc1f426-abc7-5a13-a124-22b8d114c3c7 with identifier: 1877961
2026-01-28 20:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9dc1f426-abc7-5a13-a124-22b8d114c3c7 with identifier: 1877961
2026-01-28 20:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9dc1f426-abc7-5a13-a124-22b8d114c3c7 with identifier: 1877961 to the API
2026-01-28 20:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 107,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '9dc1f426-abc7-5a13-a124-22b8d114c3c7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 23027,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 372174,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432562,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409102,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327002,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322638,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9dc1f426-abc7-5a13-a124-22b8d114c3c7/9dc1f426-abc7-5a13-a124-22b8d114c3c7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176299,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/de27688e0a31415caedd0ed88e1c999b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-22',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Dolcevita',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Dolcevita',
'vin': None,
'year': 2022}
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877961%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [ayvens.fr] INFO: Saving data for 1877961: {'created_time': 1769630793.184679, 'last_price_update_time': 1769630793.184691, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877961') HTTP/1.1" 204 0
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40a5150>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/2.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e4610>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/1.jpg saved to cache
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/4.jpg not downloaded yet
2026-01-28 20:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425c2d0>
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/3.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ae990>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/4.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/5.jpg not downloaded yet
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/6.jpg not downloaded yet
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e4dd0>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/6.jpg saved to cache
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/7.jpg not downloaded yet
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c7e10>
2026-01-28 20:06:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/5.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4231810>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/7.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4487050>
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Ffde3fae82bee4a33bcc13fb18d40cae7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/8.jpg saved to cache
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00
2026-01-28 20:06:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aea5faef-0a68-575b-abc2-3fbbe4ff2a00, skipping ID generation
2026-01-28 20:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00 with scrape type 1
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Removing item aea5faef-0a68-575b-abc2-3fbbe4ff2a00 from tracking dictionaries
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aea5faef-0a68-575b-abc2-3fbbe4ff2a00 sending to next pipeline
2026-01-28 20:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: aea5faef-0a68-575b-abc2-3fbbe4ff2a00, identifier: 1877962
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/8.jpg not downloaded yet
2026-01-28 20:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: aea5faef-0a68-575b-abc2-3fbbe4ff2a00 with identifier: 1877962
2026-01-28 20:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: aea5faef-0a68-575b-abc2-3fbbe4ff2a00 with identifier: 1877962
2026-01-28 20:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: aea5faef-0a68-575b-abc2-3fbbe4ff2a00 spider: ayvens.fr
2026-01-28 20:06:36 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: aea5faef-0a68-575b-abc2-3fbbe4ff2a00 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'aea5faef-0a68-575b-abc2-3fbbe4ff2a00',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 80567,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 496116,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 417998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 393201,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 378753,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 244836,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aea5faef-0a68-575b-abc2-3fbbe4ff2a00/aea5faef-0a68-575b-abc2-3fbbe4ff2a00_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260519,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/fde3fae82bee4a33bcc13fb18d40cae7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877962%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [ayvens.fr] INFO: Saving data for 1877962: {'created_time': 1769630796.07682, 'last_price_update_time': 1769630796.07683, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877962') HTTP/1.1" 204 0
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:36 [ayvens.fr] INFO: Found listing with ID: 1877964
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877964%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [ayvens.fr] INFO: Scrape type for 1877964: 1
2026-01-28 20:06:36 [ayvens.fr] INFO: Extracting data for car ID: 1877964
2026-01-28 20:06:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70eb4573-58b2-5170-ad49-9befa43c54ce with identifier: 1877964
2026-01-28 20:06:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70eb4573-58b2-5170-ad49-9befa43c54ce with scrape type 1
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/1.jpg not downloaded yet
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40b1190>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/1.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/2.jpg not downloaded yet
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/3.jpg not downloaded yet
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1a2f50>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/2.jpg saved to cache
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/4.jpg not downloaded yet
2026-01-28 20:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/5.jpg not downloaded yet
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c470eb90>
2026-01-28 20:06:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/3.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d3fd0>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/4.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40cbcd0>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/5.jpg saved to cache
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/6.jpg not downloaded yet
2026-01-28 20:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff28210>
2026-01-28 20:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/7.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/7.jpg not downloaded yet
2026-01-28 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/8.jpg not downloaded yet
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45840d0>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/6.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4485290>
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgj-%252Ff4375a196c9147968db11d7fa88c0186%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/8.jpg saved to cache
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97
2026-01-28 20:06:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97, skipping ID generation
2026-01-28 20:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 with scrape type 1
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 from tracking dictionaries
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 sending to next pipeline
2026-01-28 20:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97, identifier: 1877963
2026-01-28 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:38 [ayvens.fr] INFO: Found listing with ID: 1877965
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877965%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [ayvens.fr] INFO: Scrape type for 1877965: 1
2026-01-28 20:06:38 [ayvens.fr] INFO: Extracting data for car ID: 1877965
2026-01-28 20:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 501ccdae-9cf5-5c78-951b-b006a0162bdb with identifier: 1877965
2026-01-28 20:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501ccdae-9cf5-5c78-951b-b006a0162bdb with scrape type 1
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/1.jpg not downloaded yet
2026-01-28 20:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 with identifier: 1877963
2026-01-28 20:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 with identifier: 1877963
2026-01-28 20:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:06:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 spider: ayvens.fr
2026-01-28 20:06:39 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 75ff7b96-07e9-5cdd-a889-ff996e8f0c97 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 25,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': '75ff7b96-07e9-5cdd-a889-ff996e8f0c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 85481,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 443586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 438858,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 423766,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312275,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 441668,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386316,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75ff7b96-07e9-5cdd-a889-ff996e8f0c97/75ff7b96-07e9-5cdd-a889-ff996e8f0c97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gj-/f4375a196c9147968db11d7fa88c0186/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 265ch PHEV Active Business BVA6 4x4',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 265ch PHEV Active Business BVA6 4x4',
'vin': None,
'year': 2022}
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877963%27 HTTP/1.1" 200 None
2026-01-28 20:06:39 [ayvens.fr] INFO: Saving data for 1877963: {'created_time': 1769630799.269232, 'last_price_update_time': 1769630799.269247, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877963') HTTP/1.1" 204 0
2026-01-28 20:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/2.jpg not downloaded yet
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41aef50>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/1.jpg saved to cache
2026-01-28 20:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff17f50>
2026-01-28 20:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/3.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425c990>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/2.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/3.jpg not downloaded yet
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e78d0>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/4.jpg saved to cache
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/4.jpg not downloaded yet
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/5.jpg not downloaded yet
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419ecd0>
2026-01-28 20:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/5.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/6.jpg not downloaded yet
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418cdd0>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/6.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/7.jpg not downloaded yet
2026-01-28 20:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/8.jpg not downloaded yet
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff14a10>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/7.jpg saved to cache
2026-01-28 20:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b8910>
2026-01-28 20:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffq-%252F4aa59f3eddc0424f8e07915bb1c5fa2f%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/8.jpg saved to cache
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 70eb4573-58b2-5170-ad49-9befa43c54ce
2026-01-28 20:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 70eb4573-58b2-5170-ad49-9befa43c54ce, skipping ID generation
2026-01-28 20:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70eb4573-58b2-5170-ad49-9befa43c54ce with scrape type 1
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 70eb4573-58b2-5170-ad49-9befa43c54ce from tracking dictionaries
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 70eb4573-58b2-5170-ad49-9befa43c54ce sending to next pipeline
2026-01-28 20:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 70eb4573-58b2-5170-ad49-9befa43c54ce, identifier: 1877964
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [ayvens.fr] INFO: Found listing with ID: 1877966
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877966%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [ayvens.fr] INFO: Scrape type for 1877966: 1
2026-01-28 20:06:42 [ayvens.fr] INFO: Extracting data for car ID: 1877966
2026-01-28 20:06:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a with identifier: 1877966
2026-01-28 20:06:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a with scrape type 1
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg not downloaded yet
2026-01-28 20:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 70eb4573-58b2-5170-ad49-9befa43c54ce with identifier: 1877964
2026-01-28 20:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 70eb4573-58b2-5170-ad49-9befa43c54ce with identifier: 1877964
2026-01-28 20:06:42 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 70eb4573-58b2-5170-ad49-9befa43c54ce with identifier: 1877964 to the API
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 109,
'color': 'GRIS TITANIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '70eb4573-58b2-5170-ad49-9befa43c54ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 100109,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 436337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 361463,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320541,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336318,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386564,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_70eb4573-58b2-5170-ad49-9befa43c54ce/70eb4573-58b2-5170-ad49-9befa43c54ce_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 435594,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fq-/4aa59f3eddc0424f8e07915bb1c5fa2f/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-06-23',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.5 Blue dCi 85ch Business',
'transmission': 'manual',
'trim': 'Clio 1.5 Blue dCi 85ch Business',
'vin': None,
'year': 2020}
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877964%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [ayvens.fr] INFO: Saving data for 1877964: {'created_time': 1769630802.829902, 'last_price_update_time': 1769630802.829917, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877964') HTTP/1.1" 204 0
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg not downloaded yet
2026-01-28 20:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41dba90>
2026-01-28 20:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/1.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42a7510>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/2.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg not downloaded yet
2026-01-28 20:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg not downloaded yet
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45bae50>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/3.jpg saved to cache
2026-01-28 20:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cdf50>
2026-01-28 20:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/4.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg not downloaded yet
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41563d0>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/6.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg not downloaded yet
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg not downloaded yet
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d0610>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/5.jpg saved to cache
2026-01-28 20:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454d2d0>
2026-01-28 20:06:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/7.jpg saved to cache
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40fe3d0>
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252Fd6f24f11d388408489206fc3d4a01529%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/8.jpg saved to cache
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 501ccdae-9cf5-5c78-951b-b006a0162bdb
2026-01-28 20:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 501ccdae-9cf5-5c78-951b-b006a0162bdb, skipping ID generation
2026-01-28 20:06:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 501ccdae-9cf5-5c78-951b-b006a0162bdb with scrape type 1
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 501ccdae-9cf5-5c78-951b-b006a0162bdb from tracking dictionaries
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 501ccdae-9cf5-5c78-951b-b006a0162bdb sending to next pipeline
2026-01-28 20:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 501ccdae-9cf5-5c78-951b-b006a0162bdb, identifier: 1877965
2026-01-28 20:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 501ccdae-9cf5-5c78-951b-b006a0162bdb with identifier: 1877965
2026-01-28 20:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 501ccdae-9cf5-5c78-951b-b006a0162bdb with identifier: 1877965
2026-01-28 20:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 501ccdae-9cf5-5c78-951b-b006a0162bdb spider: ayvens.fr
2026-01-28 20:06:45 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 501ccdae-9cf5-5c78-951b-b006a0162bdb due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '501ccdae-9cf5-5c78-951b-b006a0162bdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 80401,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 504001,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 449761,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414304,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293744,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_501ccdae-9cf5-5c78-951b-b006a0162bdb/501ccdae-9cf5-5c78-951b-b006a0162bdb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279585,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/d6f24f11d388408489206fc3d4a01529/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-27',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877965%27 HTTP/1.1" 200 None
2026-01-28 20:06:45 [ayvens.fr] INFO: Saving data for 1877965: {'created_time': 1769630805.943887, 'last_price_update_time': 1769630805.943899, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877965') HTTP/1.1" 204 0
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg not downloaded yet
2026-01-28 20:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41cfd90>
2026-01-28 20:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg saved to cache
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ce4d0>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg saved to cache
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:46 [ayvens.fr] INFO: Found listing with ID: 1877967
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877967%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [ayvens.fr] INFO: Scrape type for 1877967: 1
2026-01-28 20:06:46 [ayvens.fr] INFO: Extracting data for car ID: 1877967
2026-01-28 20:06:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8327cda0-38ff-5560-806b-3b9b8ad1c165 with identifier: 1877967
2026-01-28 20:06:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8327cda0-38ff-5560-806b-3b9b8ad1c165 with scrape type 1
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/1.jpg not downloaded yet
2026-01-28 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/2.jpg not downloaded yet
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d2350>
2026-01-28 20:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/3.jpg not downloaded yet
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4419f50>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4464610>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/4.jpg not downloaded yet
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/5.jpg not downloaded yet
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4074ed0>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg saved to cache
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/6.jpg not downloaded yet
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4419290>
2026-01-28 20:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg saved to cache
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/7.jpg not downloaded yet
2026-01-28 20:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/8.jpg not downloaded yet
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41431d0>
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252F9b354f4eb524460bafbd18609391180b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg saved to cache
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a
2026-01-28 20:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a, skipping ID generation
2026-01-28 20:06:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a with scrape type 1
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a from tracking dictionaries
2026-01-28 20:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a sending to next pipeline
2026-01-28 20:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a, identifier: 1877966
2026-01-28 20:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a with identifier: 1877966
2026-01-28 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a with identifier: 1877966
2026-01-28 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 1.2 puretech 83ch s&s feel business', 'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business', 'price': 0, 'odometer': 70676, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-25', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 121, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 275581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 275581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 268917}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 272818}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242336}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 237822}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 299556}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 439307}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 70676}
Failed validating None in schema:
False
On instance:
{'age_in_months': 47,
'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 70676,
'odometer_in_km': 70676,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business',
'transmission': 'manual',
'trim': 'c3 1.2 puretech 83ch s&s feel business',
'vin': None,
'year': 2022}
2026-01-28 20:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a spider: ayvens.fr
2026-01-28 20:06:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blanc banquise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 1.2 puretech 83ch s&s feel business', 'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business', 'price': 0, 'odometer': 70676, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-25', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 121, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 275581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 275581}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 268917}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 272818}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242336}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 237822}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 299556}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 439307}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 70676}
Failed validating None in schema:
False
On instance:
{'age_in_months': 47,
'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'blanc banquise',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 70676,
'odometer_in_km': 70676,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c3 c3 1.2 puretech 83ch s&s feel business',
'transmission': 'manual',
'trim': 'c3 1.2 puretech 83ch s&s feel business',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 70676,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 275581,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 268917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272818,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242336,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237822,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 299556,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a/4633a1ea-8c5a-5b8c-bd17-5ae60715ff7a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 439307,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/9b354f4eb524460bafbd18609391180b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 1.2 PureTech 83ch S&S Feel Business',
'transmission': 'manual',
'trim': 'C3 1.2 PureTech 83ch S&S Feel Business',
'vin': None,
'year': 2022}
2026-01-28 20:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877966%27 HTTP/1.1" 200 None
2026-01-28 20:06:49 [ayvens.fr] INFO: Saving data for 1877966: {'created_time': 1769630809.00867, 'last_price_update_time': 1769630809.008683, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877966') HTTP/1.1" 204 0
2026-01-28 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:49 [ayvens.fr] INFO: Found listing with ID: 1877968
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877968%27 HTTP/1.1" 200 None
2026-01-28 20:06:49 [ayvens.fr] INFO: Scrape type for 1877968: 1
2026-01-28 20:06:49 [ayvens.fr] INFO: Extracting data for car ID: 1877968
2026-01-28 20:06:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b with identifier: 1877968
2026-01-28 20:06:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b with scrape type 1
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/1.jpg not downloaded yet
2026-01-28 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412a410>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/1.jpg saved to cache
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/2.jpg not downloaded yet
2026-01-28 20:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/3.jpg not downloaded yet
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4484c50>
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/2.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425c310>
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/3.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418c6d0>
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/4.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/4.jpg not downloaded yet
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf143c10>
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/6.jpg saved to cache
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/5.jpg not downloaded yet
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/6.jpg not downloaded yet
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4380610>
2026-01-28 20:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/5.jpg saved to cache
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b4d90>
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/7.jpg saved to cache
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/7.jpg not downloaded yet
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/8.jpg not downloaded yet
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:51 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 500
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45873d0>
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffw-%252F200b535dd75c4e9f83013632bca36119%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/8.jpg saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8327cda0-38ff-5560-806b-3b9b8ad1c165
2026-01-28 20:06:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8327cda0-38ff-5560-806b-3b9b8ad1c165, skipping ID generation
2026-01-28 20:06:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8327cda0-38ff-5560-806b-3b9b8ad1c165 with scrape type 1
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8327cda0-38ff-5560-806b-3b9b8ad1c165 from tracking dictionaries
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8327cda0-38ff-5560-806b-3b9b8ad1c165 sending to next pipeline
2026-01-28 20:06:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8327cda0-38ff-5560-806b-3b9b8ad1c165, identifier: 1877967
2026-01-28 20:06:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8327cda0-38ff-5560-806b-3b9b8ad1c165 with identifier: 1877967
2026-01-28 20:06:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8327cda0-38ff-5560-806b-3b9b8ad1c165 with identifier: 1877967
2026-01-28 20:06:52 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 8327cda0-38ff-5560-806b-3b9b8ad1c165 with identifier: 1877967 to the API
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 118,
'color': 'BLANCHE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '8327cda0-38ff-5560-806b-3b9b8ad1c165',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 24937,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 424712,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 427942,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298622,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335131,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298093,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272348,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8327cda0-38ff-5560-806b-3b9b8ad1c165/8327cda0-38ff-5560-806b-3b9b8ad1c165_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fw-/200b535dd75c4e9f83013632bca36119/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-08',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.0 TCe 90ch Business',
'transmission': 'manual',
'trim': 'Clio 1.0 TCe 90ch Business',
'vin': None,
'year': 2021}
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877967%27 HTTP/1.1" 200 None
2026-01-28 20:06:52 [ayvens.fr] INFO: Saving data for 1877967: {'created_time': 1769630812.571659, 'last_price_update_time': 1769630812.571674, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877967') HTTP/1.1" 204 0
2026-01-28 20:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4584150>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/1.jpg saved to cache
2026-01-28 20:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414d790>
2026-01-28 20:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/2.jpg saved to cache
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4586b10>
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/4.jpg saved to cache
2026-01-28 20:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d1f90>
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/3.jpg saved to cache
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40ff8d0>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/5.jpg saved to cache
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425da50>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/6.jpg saved to cache
2026-01-28 20:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d3e10>
2026-01-28 20:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/8.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c6c10>
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgp-%252Fe606d72ffc0148be847423c6a573e727%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/7.jpg saved to cache
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b
2026-01-28 20:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b, skipping ID generation
2026-01-28 20:06:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b with scrape type 1
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b from tracking dictionaries
2026-01-28 20:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b sending to next pipeline
2026-01-28 20:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b, identifier: 1877968
2026-01-28 20:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b with identifier: 1877968
2026-01-28 20:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b with identifier: 1877968
2026-01-28 20:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b with identifier: 1877968 to the API
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/7.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 14635,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446205,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 456394,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400315,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 364929,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 260417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 408198,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b/9ef5fa39-4ee6-53e7-8380-48f15f9a9b0b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gp-/e606d72ffc0148be847423c6a573e727/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-06-29',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877968%27 HTTP/1.1" 200 None
2026-01-28 20:06:55 [ayvens.fr] INFO: Saving data for 1877968: {'created_time': 1769630815.964082, 'last_price_update_time': 1769630815.964093, 'auction_closing_time': 1769695200.0}
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877968') HTTP/1.1" 204 0
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:06:57 [ayvens.fr] INFO: Found listing with ID: 1877969
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877969%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [ayvens.fr] INFO: Scrape type for 1877969: 1
2026-01-28 20:06:57 [ayvens.fr] INFO: Extracting data for car ID: 1877969
2026-01-28 20:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12d9054e-c0d7-524a-aac6-887ad2c79de0 with identifier: 1877969
2026-01-28 20:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12d9054e-c0d7-524a-aac6-887ad2c79de0 with scrape type 1
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/1.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/2.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/3.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/4.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/5.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/6.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/7.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/8.jpg not downloaded yet
2026-01-28 20:06:57 [ayvens.fr] INFO: Found listing with ID: 1877970
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877970%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [ayvens.fr] INFO: Scrape type for 1877970: 1
2026-01-28 20:06:57 [ayvens.fr] INFO: Extracting data for car ID: 1877970
2026-01-28 20:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5af3f47c-145d-5ce7-a880-4d6af3656075 with identifier: 1877970
2026-01-28 20:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af3f47c-145d-5ce7-a880-4d6af3656075 with scrape type 1
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/1.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/2.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/3.jpg not downloaded yet
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/4.jpg not downloaded yet
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/5.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/6.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/7.jpg not downloaded yet
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/8.jpg not downloaded yet
2026-01-28 20:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:57 [ayvens.fr] INFO: Found listing with ID: 1877971
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877971%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [ayvens.fr] INFO: Scrape type for 1877971: 1
2026-01-28 20:06:57 [ayvens.fr] INFO: Extracting data for car ID: 1877971
2026-01-28 20:06:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 with identifier: 1877971
2026-01-28 20:06:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 with scrape type 1
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/1.jpg not downloaded yet
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/2.jpg not downloaded yet
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4322a10>
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/2.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407d210>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/6.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaee990>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/5.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff53290>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/4.jpg saved to cache
2026-01-28 20:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4504110>
2026-01-28 20:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/1.jpg saved to cache
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/3.jpg not downloaded yet
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45a8450>
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/8.jpg saved to cache
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d3610>
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/3.jpg saved to cache
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/4.jpg not downloaded yet
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/5.jpg not downloaded yet
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41980d0>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252F6844e50fb86e41b981bba1e3ad904cd9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/7.jpg saved to cache
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 12d9054e-c0d7-524a-aac6-887ad2c79de0
2026-01-28 20:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 12d9054e-c0d7-524a-aac6-887ad2c79de0, skipping ID generation
2026-01-28 20:07:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12d9054e-c0d7-524a-aac6-887ad2c79de0 with scrape type 1
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 12d9054e-c0d7-524a-aac6-887ad2c79de0 from tracking dictionaries
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 12d9054e-c0d7-524a-aac6-887ad2c79de0 sending to next pipeline
2026-01-28 20:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 12d9054e-c0d7-524a-aac6-887ad2c79de0, identifier: 1877969
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 12d9054e-c0d7-524a-aac6-887ad2c79de0 with identifier: 1877969
2026-01-28 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 12d9054e-c0d7-524a-aac6-887ad2c79de0 with identifier: 1877969
2026-01-28 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 12d9054e-c0d7-524a-aac6-887ad2c79de0 spider: ayvens.fr
2026-01-28 20:07:00 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 12d9054e-c0d7-524a-aac6-887ad2c79de0 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 126,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '12d9054e-c0d7-524a-aac6-887ad2c79de0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 49848,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322705,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 305458,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307025,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_12d9054e-c0d7-524a-aac6-887ad2c79de0/12d9054e-c0d7-524a-aac6-887ad2c79de0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314365,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/6844e50fb86e41b981bba1e3ad904cd9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-03-09',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV Active Business BVA6 4x2',
'vin': None,
'year': 2023}
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877969%27 HTTP/1.1" 200 None
2026-01-28 20:07:00 [ayvens.fr] INFO: Saving data for 1877969: {'created_time': 1769630820.855417, 'last_price_update_time': 1769630820.85543, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877969') HTTP/1.1" 204 0
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/6.jpg not downloaded yet
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ec910>
2026-01-28 20:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/1.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4323ad0>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/2.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b2250>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/3.jpg saved to cache
2026-01-28 20:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4575190>
2026-01-28 20:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/4.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/7.jpg not downloaded yet
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4375190>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/6.jpg saved to cache
2026-01-28 20:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4348150>
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/5.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c416c390>
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/7.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/8.jpg not downloaded yet
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [ayvens.fr] INFO: Found listing with ID: 1877972
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877972%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [ayvens.fr] INFO: Scrape type for 1877972: 1
2026-01-28 20:07:03 [ayvens.fr] INFO: Extracting data for car ID: 1877972
2026-01-28 20:07:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bcfcf2b-5a30-529e-946e-88134bc79f12 with identifier: 1877972
2026-01-28 20:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bcfcf2b-5a30-529e-946e-88134bc79f12 with scrape type 1
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg not downloaded yet
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg not downloaded yet
2026-01-28 20:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg not downloaded yet
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b9a90>
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgd-%252Fb3e1a7f2b0204888b96412273424869a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/8.jpg saved to cache
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5af3f47c-145d-5ce7-a880-4d6af3656075
2026-01-28 20:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5af3f47c-145d-5ce7-a880-4d6af3656075, skipping ID generation
2026-01-28 20:07:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5af3f47c-145d-5ce7-a880-4d6af3656075 with scrape type 1
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5af3f47c-145d-5ce7-a880-4d6af3656075 from tracking dictionaries
2026-01-28 20:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5af3f47c-145d-5ce7-a880-4d6af3656075 sending to next pipeline
2026-01-28 20:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5af3f47c-145d-5ce7-a880-4d6af3656075, identifier: 1877970
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg not downloaded yet
2026-01-28 20:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5af3f47c-145d-5ce7-a880-4d6af3656075 with identifier: 1877970
2026-01-28 20:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5af3f47c-145d-5ce7-a880-4d6af3656075 with identifier: 1877970
2026-01-28 20:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 5af3f47c-145d-5ce7-a880-4d6af3656075 with identifier: 1877970 to the API
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 37,
'color': 'GRIS ARTENSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': '5af3f47c-145d-5ce7-a880-4d6af3656075',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS7',
'odometer': 76091,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351682,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337096,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302058,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 376568,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328158,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323452,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5af3f47c-145d-5ce7-a880-4d6af3656075/5af3f47c-145d-5ce7-a880-4d6af3656075_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 273395,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gd-/b3e1a7f2b0204888b96412273424869a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-12-14',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS7 DS 7 Crossback E-TENSE 225ch Grand Chic',
'transmission': 'automatic',
'trim': 'DS 7 Crossback E-TENSE 225ch Grand Chic',
'vin': None,
'year': 2021}
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877970%27 HTTP/1.1" 200 None
2026-01-28 20:07:04 [ayvens.fr] INFO: Saving data for 1877970: {'created_time': 1769630824.420509, 'last_price_update_time': 1769630824.420523, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877970') HTTP/1.1" 204 0
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4282a10>
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/2.jpg saved to cache
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg not downloaded yet
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4375a10>
2026-01-28 20:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/1.jpg saved to cache
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41d8bd0>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/3.jpg saved to cache
2026-01-28 20:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435f8d0>
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/4.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412a690>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/5.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg not downloaded yet
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg not downloaded yet
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg not downloaded yet
2026-01-28 20:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:06 [ayvens.fr] INFO: Found listing with ID: 1877973
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877973%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [ayvens.fr] INFO: Scrape type for 1877973: 1
2026-01-28 20:07:06 [ayvens.fr] INFO: Extracting data for car ID: 1877973
2026-01-28 20:07:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 572bddce-61d7-54ff-aa21-0edea8ee036e with identifier: 1877973
2026-01-28 20:07:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572bddce-61d7-54ff-aa21-0edea8ee036e with scrape type 1
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg not downloaded yet
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg not downloaded yet
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4086310>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/6.jpg saved to cache
2026-01-28 20:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4085950>
2026-01-28 20:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/8.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40842d0>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffl-%252F539513ffe1904fb5a51328f215107b56%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/7.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3
2026-01-28 20:07:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3, skipping ID generation
2026-01-28 20:07:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 with scrape type 1
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 from tracking dictionaries
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 sending to next pipeline
2026-01-28 20:07:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3, identifier: 1877971
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfb0c7d0>
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg saved to cache
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg not downloaded yet
2026-01-28 20:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 with identifier: 1877971
2026-01-28 20:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 with identifier: 1877971
2026-01-28 20:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 spider: ayvens.fr
2026-01-28 20:07:08 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 8c2266e5-06aa-59d7-9aa2-3fb173e43ec3 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 84,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '8c2266e5-06aa-59d7-9aa2-3fb173e43ec3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'TOYOTA',
'model': 'YARIS HYBRID',
'odometer': 129170,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383146,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363770,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311681,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289338,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 225113,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 295089,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c2266e5-06aa-59d7-9aa2-3fb173e43ec3/8c2266e5-06aa-59d7-9aa2-3fb173e43ec3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250983,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fl-/539513ffe1904fb5a51328f215107b56/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-11-22',
'seats_number': 5,
'seller_name': None,
'title': 'TOYOTA YARIS HYBRID Yaris 100h France Business 5p',
'transmission': 'automatic',
'trim': 'Yaris 100h France Business 5p',
'vin': None,
'year': 2019}
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877971%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [ayvens.fr] INFO: Saving data for 1877971: {'created_time': 1769630828.183383, 'last_price_update_time': 1769630828.183397, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877971') HTTP/1.1" 204 0
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4393710>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg not downloaded yet
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b3f10>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg saved to cache
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg not downloaded yet
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg not downloaded yet
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4534690>
2026-01-28 20:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg saved to cache
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg not downloaded yet
2026-01-28 20:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg not downloaded yet
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435c550>
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg saved to cache
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41577d0>
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg saved to cache
2026-01-28 20:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c434b810>
2026-01-28 20:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg saved to cache
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41fb350>
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b8db54f010847098bd93460be04b171%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg saved to cache
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6bcfcf2b-5a30-529e-946e-88134bc79f12
2026-01-28 20:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6bcfcf2b-5a30-529e-946e-88134bc79f12, skipping ID generation
2026-01-28 20:07:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bcfcf2b-5a30-529e-946e-88134bc79f12 with scrape type 1
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6bcfcf2b-5a30-529e-946e-88134bc79f12 from tracking dictionaries
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6bcfcf2b-5a30-529e-946e-88134bc79f12 sending to next pipeline
2026-01-28 20:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6bcfcf2b-5a30-529e-946e-88134bc79f12, identifier: 1877972
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c62f7c50>
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg saved to cache
2026-01-28 20:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:10 [ayvens.fr] INFO: Found listing with ID: 1877974
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877974%27 HTTP/1.1" 200 None
2026-01-28 20:07:10 [ayvens.fr] INFO: Scrape type for 1877974: 1
2026-01-28 20:07:10 [ayvens.fr] INFO: Extracting data for car ID: 1877974
2026-01-28 20:07:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37e163e7-68b4-53e6-a665-f7776648415e with identifier: 1877974
2026-01-28 20:07:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e163e7-68b4-53e6-a665-f7776648415e with scrape type 1
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/1.jpg not downloaded yet
2026-01-28 20:07:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6bcfcf2b-5a30-529e-946e-88134bc79f12 with identifier: 1877972
2026-01-28 20:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6bcfcf2b-5a30-529e-946e-88134bc79f12 with identifier: 1877972
2026-01-28 20:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'vert aventurine', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'kia', 'model': 'niro ev', 'trim': 'niro ev 204ch active business', 'title': 'kia niro ev niro ev 204ch active business', 'price': 0, 'odometer': 102401, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-17', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.2l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '6bcfcf2b-5a30-529e-946e-88134bc79f12', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 354431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 354431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 343392}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 344279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 264169}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 315538}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 291599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 363011}], 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'kia niro ev', 'sanitized_make': 'kia', 'odometer_in_km': 102401} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'vert aventurine',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.2l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '6bcfcf2b-5a30-529e-946e-88134bc79f12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'kia',
'make_model': 'kia niro ev',
'model': 'niro ev',
'odometer': 102401,
'odometer_in_km': 102401,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-17',
'sanitized_make': 'kia',
'seats_number': 5,
'seller_name': None,
'title': 'kia niro ev niro ev 204ch active business',
'transmission': 'automatic',
'trim': 'niro ev 204ch active business',
'vin': None,
'year': 2023}
2026-01-28 20:07:11 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 6bcfcf2b-5a30-529e-946e-88134bc79f12 spider: ayvens.fr
2026-01-28 20:07:11 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6bcfcf2b-5a30-529e-946e-88134bc79f12 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'vert aventurine', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'kia', 'model': 'niro ev', 'trim': 'niro ev 204ch active business', 'title': 'kia niro ev niro ev 204ch active business', 'price': 0, 'odometer': 102401, 'odometer_reading_unit': 'km', 'registration_date': '2023-07-17', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.2l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '6bcfcf2b-5a30-529e-946e-88134bc79f12', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 354431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 354431}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 343392}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 344279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 264169}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 315538}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 291599}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 363011}], 'current_year_diff': 3, 'age_in_months': 30, 'make_model': 'kia niro ev', 'sanitized_make': 'kia', 'odometer_in_km': 102401} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 30,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'vert aventurine',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.2l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '6bcfcf2b-5a30-529e-946e-88134bc79f12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'kia',
'make_model': 'kia niro ev',
'model': 'niro ev',
'odometer': 102401,
'odometer_in_km': 102401,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-17',
'sanitized_make': 'kia',
'seats_number': 5,
'seller_name': None,
'title': 'kia niro ev niro ev 204ch active business',
'transmission': 'automatic',
'trim': 'niro ev 204ch active business',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'VERT AVENTURINE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': '6bcfcf2b-5a30-529e-946e-88134bc79f12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 102401,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354431,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 343392,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 264169,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 315538,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 291599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6bcfcf2b-5a30-529e-946e-88134bc79f12/6bcfcf2b-5a30-529e-946e-88134bc79f12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363011,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b8db54f010847098bd93460be04b171/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-17',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Active Business',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Active Business',
'vin': None,
'year': 2023}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877972%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [ayvens.fr] INFO: Saving data for 1877972: {'created_time': 1769630831.42245, 'last_price_update_time': 1769630831.422463, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877972') HTTP/1.1" 204 0
2026-01-28 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/2.jpg not downloaded yet
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a6d50>
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg saved to cache
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/3.jpg not downloaded yet
2026-01-28 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425e710>
2026-01-28 20:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4507b10>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/4.jpg not downloaded yet
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/5.jpg not downloaded yet
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4506e90>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg saved to cache
2026-01-28 20:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ecc90>
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg saved to cache
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/6.jpg not downloaded yet
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/7.jpg not downloaded yet
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45b8650>
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg saved to cache
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d3910>
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgn-%252F6f8fcc2d09154703ba21b30826a9006d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg saved to cache
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 572bddce-61d7-54ff-aa21-0edea8ee036e
2026-01-28 20:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 572bddce-61d7-54ff-aa21-0edea8ee036e, skipping ID generation
2026-01-28 20:07:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 572bddce-61d7-54ff-aa21-0edea8ee036e with scrape type 1
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 572bddce-61d7-54ff-aa21-0edea8ee036e from tracking dictionaries
2026-01-28 20:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 572bddce-61d7-54ff-aa21-0edea8ee036e sending to next pipeline
2026-01-28 20:07:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 572bddce-61d7-54ff-aa21-0edea8ee036e, identifier: 1877973
2026-01-28 20:07:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 572bddce-61d7-54ff-aa21-0edea8ee036e with identifier: 1877973
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 572bddce-61d7-54ff-aa21-0edea8ee036e with identifier: 1877973
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': None, 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'kia', 'model': 'niro ev', 'trim': 'niro ev 204ch premium business', 'title': 'kia niro ev niro ev 204ch premium business', 'price': 0, 'odometer': 46730, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-12', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.2l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '572bddce-61d7-54ff-aa21-0edea8ee036e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 322000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 322000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 354924}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317438}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 307741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 322078}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 203280}], 'current_year_diff': 3, 'age_in_months': 32, 'make_model': 'kia niro ev', 'sanitized_make': 'kia', 'odometer_in_km': 46730} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 32,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.2l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '572bddce-61d7-54ff-aa21-0edea8ee036e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'kia',
'make_model': 'kia niro ev',
'model': 'niro ev',
'odometer': 46730,
'odometer_in_km': 46730,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'sanitized_make': 'kia',
'seats_number': 5,
'seller_name': None,
'title': 'kia niro ev niro ev 204ch premium business',
'transmission': 'automatic',
'trim': 'niro ev 204ch premium business',
'vin': None,
'year': 2023}
2026-01-28 20:07:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 572bddce-61d7-54ff-aa21-0edea8ee036e spider: ayvens.fr
2026-01-28 20:07:14 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 572bddce-61d7-54ff-aa21-0edea8ee036e due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': None, 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'kia', 'model': 'niro ev', 'trim': 'niro ev 204ch premium business', 'title': 'kia niro ev niro ev 204ch premium business', 'price': 0, 'odometer': 46730, 'odometer_reading_unit': 'km', 'registration_date': '2023-05-12', 'year': 2023, 'fuel_type': 'electric', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.2l', 'c_o_2_emission_value': 0, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '572bddce-61d7-54ff-aa21-0edea8ee036e', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 322000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 322000}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346035}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 354924}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317438}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 307741}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 322078}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 203280}], 'current_year_diff': 3, 'age_in_months': 32, 'make_model': 'kia niro ev', 'sanitized_make': 'kia', 'odometer_in_km': 46730} is not valid under any of the given schemas
Failed validating 'anyOf' in schema['then']:
{'anyOf': [{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'gb'}}},
{'properties': {'make': {'const': 'tesla'},
'origin_country_code': {'const': 'uk'}}},
{'properties': {'origin_country_code': {'const': 'pt'}}},
{'properties': {'origin_country_code': {'const': 'be'}}}]}
On instance:
{'age_in_months': 32,
'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.2l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'electric',
'id': '572bddce-61d7-54ff-aa21-0edea8ee036e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'kia',
'make_model': 'kia niro ev',
'model': 'niro ev',
'odometer': 46730,
'odometer_in_km': 46730,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'sanitized_make': 'kia',
'seats_number': 5,
'seller_name': None,
'title': 'kia niro ev niro ev 204ch premium business',
'transmission': 'automatic',
'trim': 'niro ev 204ch premium business',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': '572bddce-61d7-54ff-aa21-0edea8ee036e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'NIRO EV',
'odometer': 46730,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322000,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346035,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354924,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317438,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307741,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 322078,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_572bddce-61d7-54ff-aa21-0edea8ee036e/572bddce-61d7-54ff-aa21-0edea8ee036e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 203280,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gn-/6f8fcc2d09154703ba21b30826a9006d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-05-12',
'seats_number': 5,
'seller_name': None,
'title': 'KIA NIRO EV Niro EV 204ch Premium Business',
'transmission': 'automatic',
'trim': 'Niro EV 204ch Premium Business',
'vin': None,
'year': 2023}
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877973%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [ayvens.fr] INFO: Saving data for 1877973: {'created_time': 1769630834.036017, 'last_price_update_time': 1769630834.036029, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877973') HTTP/1.1" 204 0
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/8.jpg not downloaded yet
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412a1d0>
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/1.jpg saved to cache
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:14 [ayvens.fr] INFO: Found listing with ID: 1877975
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877975%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [ayvens.fr] INFO: Scrape type for 1877975: 1
2026-01-28 20:07:14 [ayvens.fr] INFO: Extracting data for car ID: 1877975
2026-01-28 20:07:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f740ef8-823a-563e-b808-0916b24107fc with identifier: 1877975
2026-01-28 20:07:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f740ef8-823a-563e-b808-0916b24107fc with scrape type 1
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/1.jpg not downloaded yet
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/2.jpg not downloaded yet
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45bbc90>
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/2.jpg saved to cache
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/3.jpg not downloaded yet
2026-01-28 20:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/4.jpg not downloaded yet
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41e63d0>
2026-01-28 20:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/3.jpg saved to cache
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4486d10>
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/4.jpg saved to cache
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1eefd0>
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/5.jpg saved to cache
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/5.jpg not downloaded yet
2026-01-28 20:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/6.jpg not downloaded yet
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435e2d0>
2026-01-28 20:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/6.jpg saved to cache
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/7.jpg not downloaded yet
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/8.jpg not downloaded yet
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff53690>
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/7.jpg saved to cache
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:16 [ayvens.fr] INFO: Found listing with ID: 1877976
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877976%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [ayvens.fr] INFO: Scrape type for 1877976: 1
2026-01-28 20:07:16 [ayvens.fr] INFO: Extracting data for car ID: 1877976
2026-01-28 20:07:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b with identifier: 1877976
2026-01-28 20:07:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b with scrape type 1
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/1.jpg not downloaded yet
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/2.jpg not downloaded yet
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4381d10>
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffy-%252F8909c0f9168e4cf3834ccc4752a5e34a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/8.jpg saved to cache
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37e163e7-68b4-53e6-a665-f7776648415e
2026-01-28 20:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37e163e7-68b4-53e6-a665-f7776648415e, skipping ID generation
2026-01-28 20:07:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37e163e7-68b4-53e6-a665-f7776648415e with scrape type 1
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 37e163e7-68b4-53e6-a665-f7776648415e from tracking dictionaries
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37e163e7-68b4-53e6-a665-f7776648415e sending to next pipeline
2026-01-28 20:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 37e163e7-68b4-53e6-a665-f7776648415e, identifier: 1877974
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46d2d50>
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/1.jpg saved to cache
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff28990>
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/2.jpg saved to cache
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/3.jpg not downloaded yet
2026-01-28 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 37e163e7-68b4-53e6-a665-f7776648415e with identifier: 1877974
2026-01-28 20:07:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 37e163e7-68b4-53e6-a665-f7776648415e with identifier: 1877974
2026-01-28 20:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 37e163e7-68b4-53e6-a665-f7776648415e with identifier: 1877974 to the API
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 140,
'color': 'GRIS PLATINUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '37e163e7-68b4-53e6-a665-f7776648415e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 129365,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304716,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304716,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 432781,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 382092,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380319,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 379748,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386311,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37e163e7-68b4-53e6-a665-f7776648415e/37e163e7-68b4-53e6-a665-f7776648415e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461041,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fy-/8909c0f9168e4cf3834ccc4752a5e34a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-04-01',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross BlueHDi 130ch S&S Business EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross BlueHDi 130ch S&S Business EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877974%27 HTTP/1.1" 200 None
2026-01-28 20:07:18 [ayvens.fr] INFO: Saving data for 1877974: {'created_time': 1769630838.111887, 'last_price_update_time': 1769630838.111903, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877974') HTTP/1.1" 204 0
2026-01-28 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/4.jpg not downloaded yet
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458b090>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/3.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4587090>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/4.jpg saved to cache
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/5.jpg not downloaded yet
2026-01-28 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/6.jpg not downloaded yet
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c5290>
2026-01-28 20:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/6.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4219e50>
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/5.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/7.jpg not downloaded yet
2026-01-28 20:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff15f10>
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/7.jpg saved to cache
2026-01-28 20:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c440ea90>
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252F34adc0c4a4534d5b9cb0829e92c280e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/8.jpg saved to cache
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f740ef8-823a-563e-b808-0916b24107fc
2026-01-28 20:07:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f740ef8-823a-563e-b808-0916b24107fc, skipping ID generation
2026-01-28 20:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f740ef8-823a-563e-b808-0916b24107fc with scrape type 1
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3f740ef8-823a-563e-b808-0916b24107fc from tracking dictionaries
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f740ef8-823a-563e-b808-0916b24107fc sending to next pipeline
2026-01-28 20:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3f740ef8-823a-563e-b808-0916b24107fc, identifier: 1877975
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/8.jpg not downloaded yet
2026-01-28 20:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3f740ef8-823a-563e-b808-0916b24107fc with identifier: 1877975
2026-01-28 20:07:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3f740ef8-823a-563e-b808-0916b24107fc with identifier: 1877975
2026-01-28 20:07:20 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 3f740ef8-823a-563e-b808-0916b24107fc with identifier: 1877975 to the API
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': 'BLANC NACRE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': '3f740ef8-823a-563e-b808-0916b24107fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 74841,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 292517,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 341935,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374792,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335414,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310820,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f740ef8-823a-563e-b808-0916b24107fc/3f740ef8-823a-563e-b808-0916b24107fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 294320,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/34adc0c4a4534d5b9cb0829e92c280e7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-11-15',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross Hybrid 225ch Business e-EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross Hybrid 225ch Business e-EAT8',
'vin': None,
'year': 2021}
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877975%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [ayvens.fr] INFO: Saving data for 1877975: {'created_time': 1769630840.569713, 'last_price_update_time': 1769630840.569744, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877975') HTTP/1.1" 204 0
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [ayvens.fr] INFO: Found listing with ID: 1877977
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877977%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [ayvens.fr] INFO: Scrape type for 1877977: 1
2026-01-28 20:07:20 [ayvens.fr] INFO: Extracting data for car ID: 1877977
2026-01-28 20:07:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f with identifier: 1877977
2026-01-28 20:07:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f with scrape type 1
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg not downloaded yet
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407dd90>
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/1.jpg saved to cache
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg not downloaded yet
2026-01-28 20:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg not downloaded yet
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c4610>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/4.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41fa950>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/2.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff34150>
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/3.jpg saved to cache
2026-01-28 20:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg not downloaded yet
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg not downloaded yet
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458be50>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/5.jpg saved to cache
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg not downloaded yet
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414f4d0>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/6.jpg saved to cache
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41fab10>
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/7.jpg saved to cache
2026-01-28 20:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg not downloaded yet
2026-01-28 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg not downloaded yet
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c407f6d0>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgl-%252Fd16423399102408ba4a2e6e096aa9131%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/8.jpg saved to cache
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b
2026-01-28 20:07:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b, skipping ID generation
2026-01-28 20:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b with scrape type 1
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b from tracking dictionaries
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b sending to next pipeline
2026-01-28 20:07:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b, identifier: 1877976
2026-01-28 20:07:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b with identifier: 1877976
2026-01-28 20:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b with identifier: 1877976
2026-01-28 20:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:07:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b spider: ayvens.fr
2026-01-28 20:07:23 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 146,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 103761,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 501934,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354376,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 247267,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289140,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280407,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237773,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b/5cd4720a-ad6b-50ec-8af2-ba3d59d40b9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 216066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gl-/d16423399102408ba4a2e6e096aa9131/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-12-08',
'seats_number': 5,
'seller_name': None,
'title': 'KIA SPORTAGE Sportage 1.6 T-GDi 230ch HEV GT-Line Premium Business '
'BVA6 4x4',
'transmission': 'automatic',
'trim': 'Sportage 1.6 T-GDi 230ch HEV GT-Line Premium Business BVA6 4x4',
'vin': None,
'year': 2022}
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877976%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [ayvens.fr] INFO: Saving data for 1877976: {'created_time': 1769630843.756401, 'last_price_update_time': 1769630843.756414, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877976') HTTP/1.1" 204 0
2026-01-28 20:07:23 [ayvens.fr] INFO: Found listing with ID: 1877978
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877978%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [ayvens.fr] INFO: Scrape type for 1877978: 1
2026-01-28 20:07:23 [ayvens.fr] INFO: Extracting data for car ID: 1877978
2026-01-28 20:07:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07d06aab-5170-52d5-904a-b327ebcb62da with identifier: 1877978
2026-01-28 20:07:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d06aab-5170-52d5-904a-b327ebcb62da with scrape type 1
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg not downloaded yet
2026-01-28 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bd610>
2026-01-28 20:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg saved to cache
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg not downloaded yet
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg not downloaded yet
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ae6d0>
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg saved to cache
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425e050>
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg saved to cache
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg not downloaded yet
2026-01-28 20:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg not downloaded yet
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c404a0d0>
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4218890>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41610d0>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg saved to cache
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg not downloaded yet
2026-01-28 20:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg not downloaded yet
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ef1d0>
2026-01-28 20:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg saved to cache
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg not downloaded yet
2026-01-28 20:07:26 [ayvens.fr] INFO: Found listing with ID: 1877979
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877979%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [ayvens.fr] INFO: Scrape type for 1877979: 1
2026-01-28 20:07:26 [ayvens.fr] INFO: Extracting data for car ID: 1877979
2026-01-28 20:07:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 282fed8d-c4cf-5562-86a7-8c281c1fad84 with identifier: 1877979
2026-01-28 20:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282fed8d-c4cf-5562-86a7-8c281c1fad84 with scrape type 1
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/1.jpg not downloaded yet
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41424d0>
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fge-%252Ff622d3cb59cd4e588242106c29c2e73e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg saved to cache
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f
2026-01-28 20:07:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f, skipping ID generation
2026-01-28 20:07:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f with scrape type 1
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f from tracking dictionaries
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f sending to next pipeline
2026-01-28 20:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f, identifier: 1877977
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/2.jpg not downloaded yet
2026-01-28 20:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f with identifier: 1877977
2026-01-28 20:07:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f with identifier: 1877977
2026-01-28 20:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium metallise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c5 aircross', 'trim': 'c5 aircross puretech 130ch s&s shine pack eat8', 'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine pack eat8', 'price': 0, 'odometer': 112684, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-25', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 150, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458444}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458444}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 478282}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 336127}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 371327}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 356667}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 297931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 360577}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'citroën c5 aircross', 'sanitized_make': 'citron', 'odometer_in_km': 112684}
Failed validating None in schema:
False
On instance:
{'age_in_months': 47,
'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'gris platinium metallise',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c5 aircross',
'model': 'c5 aircross',
'odometer': 112684,
'odometer_in_km': 112684,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine '
'pack eat8',
'transmission': 'automatic',
'trim': 'c5 aircross puretech 130ch s&s shine pack eat8',
'vin': None,
'year': 2022}
2026-01-28 20:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f spider: ayvens.fr
2026-01-28 20:07:26 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium metallise', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c5 aircross', 'trim': 'c5 aircross puretech 130ch s&s shine pack eat8', 'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine pack eat8', 'price': 0, 'odometer': 112684, 'odometer_reading_unit': 'km', 'registration_date': '2022-02-25', 'year': 2022, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 150, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458444}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 458444}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 478282}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 336127}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 371327}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 356667}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 297931}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 360577}], 'current_year_diff': 4, 'age_in_months': 47, 'make_model': 'citroën c5 aircross', 'sanitized_make': 'citron', 'odometer_in_km': 112684}
Failed validating None in schema:
False
On instance:
{'age_in_months': 47,
'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'gris platinium metallise',
'currency': 'eur',
'current_year_diff': 4,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c5 aircross',
'model': 'c5 aircross',
'odometer': 112684,
'odometer_in_km': 112684,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine '
'pack eat8',
'transmission': 'automatic',
'trim': 'c5 aircross puretech 130ch s&s shine pack eat8',
'vin': None,
'year': 2022}
{'auction_title': '',
'c_o_2_emission_value': 150,
'color': 'GRIS PLATINIUM METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 112684,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 458444,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478282,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336127,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 371327,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356667,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297931,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f/3fee4b2e-4726-51f8-8c4d-6f3ab5b93c3f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360577,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ge-/f622d3cb59cd4e588242106c29c2e73e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-02-25',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross PureTech 130ch S&S Shine Pack EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross PureTech 130ch S&S Shine Pack EAT8',
'vin': None,
'year': 2022}
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877977%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [ayvens.fr] INFO: Saving data for 1877977: {'created_time': 1769630846.819384, 'last_price_update_time': 1769630846.819395, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877977') HTTP/1.1" 204 0
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/3.jpg not downloaded yet
2026-01-28 20:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44e9090>
2026-01-28 20:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4348210>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d2a10>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg saved to cache
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/4.jpg not downloaded yet
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/5.jpg not downloaded yet
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458a350>
2026-01-28 20:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45ba150>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/6.jpg not downloaded yet
2026-01-28 20:07:28 [scrapy.extensions.logstats] INFO: Crawled 10 pages (at 1 pages/min), scraped 45 items (at 7 items/min)
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/7.jpg not downloaded yet
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4160090>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg saved to cache
2026-01-28 20:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bf550>
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg saved to cache
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a4290>
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgc-%252Fd1c24122c178481495adc3ab9181d5e2%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg saved to cache
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07d06aab-5170-52d5-904a-b327ebcb62da
2026-01-28 20:07:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07d06aab-5170-52d5-904a-b327ebcb62da, skipping ID generation
2026-01-28 20:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07d06aab-5170-52d5-904a-b327ebcb62da with scrape type 1
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 07d06aab-5170-52d5-904a-b327ebcb62da from tracking dictionaries
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07d06aab-5170-52d5-904a-b327ebcb62da sending to next pipeline
2026-01-28 20:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 07d06aab-5170-52d5-904a-b327ebcb62da, identifier: 1877978
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/8.jpg not downloaded yet
2026-01-28 20:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 07d06aab-5170-52d5-904a-b327ebcb62da with identifier: 1877978
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 07d06aab-5170-52d5-904a-b327ebcb62da with identifier: 1877978
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'ds automobiles', 'model': 'ds7', 'trim': 'ds 7 crossback puretech 130ch performance line automatique', 'title': 'ds automobiles ds7 ds 7 crossback puretech 130ch performance line automatique', 'price': 0, 'odometer': 134787, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-28', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 148, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '07d06aab-5170-52d5-904a-b327ebcb62da', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 516406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 516406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 478739}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 359917}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 400720}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 336603}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339984}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242324}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'ds automobiles ds7', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 134787}
Failed validating None in schema:
False
On instance:
{'age_in_months': 52,
'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '07d06aab-5170-52d5-904a-b327ebcb62da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'ds automobiles',
'make_model': 'ds automobiles ds7',
'model': 'ds7',
'odometer': 134787,
'odometer_in_km': 134787,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds7 ds 7 crossback puretech 130ch '
'performance line automatique',
'transmission': 'automatic',
'trim': 'ds 7 crossback puretech 130ch performance line automatique',
'vin': None,
'year': 2021}
2026-01-28 20:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 07d06aab-5170-52d5-904a-b327ebcb62da spider: ayvens.fr
2026-01-28 20:07:29 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 07d06aab-5170-52d5-904a-b327ebcb62da due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'ds automobiles', 'model': 'ds7', 'trim': 'ds 7 crossback puretech 130ch performance line automatique', 'title': 'ds automobiles ds7 ds 7 crossback puretech 130ch performance line automatique', 'price': 0, 'odometer': 134787, 'odometer_reading_unit': 'km', 'registration_date': '2021-09-28', 'year': 2021, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 148, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': '07d06aab-5170-52d5-904a-b327ebcb62da', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 516406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 516406}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 478739}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 359917}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 400720}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 336603}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 339984}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242324}], 'current_year_diff': 5, 'age_in_months': 52, 'make_model': 'ds automobiles ds7', 'sanitized_make': 'dsautomobiles', 'odometer_in_km': 134787}
Failed validating None in schema:
False
On instance:
{'age_in_months': 52,
'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 5,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '07d06aab-5170-52d5-904a-b327ebcb62da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'ds automobiles',
'make_model': 'ds automobiles ds7',
'model': 'ds7',
'odometer': 134787,
'odometer_in_km': 134787,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'sanitized_make': 'dsautomobiles',
'seats_number': 5,
'seller_name': None,
'title': 'ds automobiles ds7 ds 7 crossback puretech 130ch '
'performance line automatique',
'transmission': 'automatic',
'trim': 'ds 7 crossback puretech 130ch performance line automatique',
'vin': None,
'year': 2021}
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '07d06aab-5170-52d5-904a-b327ebcb62da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'DS AUTOMOBILES',
'model': 'DS7',
'odometer': 134787,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 516406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 478739,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 359917,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 400720,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 336603,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 339984,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07d06aab-5170-52d5-904a-b327ebcb62da/07d06aab-5170-52d5-904a-b327ebcb62da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242324,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gc-/d1c24122c178481495adc3ab9181d5e2/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-09-28',
'seats_number': 5,
'seller_name': None,
'title': 'DS AUTOMOBILES DS7 DS 7 Crossback PureTech 130ch Performance Line '
'Automatique',
'transmission': 'automatic',
'trim': 'DS 7 Crossback PureTech 130ch Performance Line Automatique',
'vin': None,
'year': 2021}
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877978%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [ayvens.fr] INFO: Saving data for 1877978: {'created_time': 1769630849.849459, 'last_price_update_time': 1769630849.849469, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877978') HTTP/1.1" 204 0
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [ayvens.fr] INFO: Found listing with ID: 1877980
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877980%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [ayvens.fr] INFO: Scrape type for 1877980: 1
2026-01-28 20:07:29 [ayvens.fr] INFO: Extracting data for car ID: 1877980
2026-01-28 20:07:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a with identifier: 1877980
2026-01-28 20:07:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a with scrape type 1
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/1.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/2.jpg not downloaded yet
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/3.jpg not downloaded yet
2026-01-28 20:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/4.jpg not downloaded yet
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/5.jpg not downloaded yet
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42be710>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/1.jpg saved to cache
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/6.jpg not downloaded yet
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/7.jpg not downloaded yet
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4306550>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/2.jpg saved to cache
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e2850>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/3.jpg saved to cache
2026-01-28 20:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4390190>
2026-01-28 20:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/4.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4255310>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/5.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42567d0>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/6.jpg saved to cache
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/8.jpg not downloaded yet
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [ayvens.fr] INFO: Found listing with ID: 1877981
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877981%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [ayvens.fr] INFO: Scrape type for 1877981: 1
2026-01-28 20:07:31 [ayvens.fr] INFO: Extracting data for car ID: 1877981
2026-01-28 20:07:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6f9bed9-f474-5af0-979e-f74eaaeffbb2 with identifier: 1877981
2026-01-28 20:07:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2 with scrape type 1
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg not downloaded yet
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg not downloaded yet
2026-01-28 20:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg not downloaded yet
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg not downloaded yet
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bf110>
2026-01-28 20:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/7.jpg saved to cache
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a5110>
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/1.jpg saved to cache
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4335b90>
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F2b7ff13c4c9947188fe8cca8c2e7b825%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/8.jpg saved to cache
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 282fed8d-c4cf-5562-86a7-8c281c1fad84
2026-01-28 20:07:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 282fed8d-c4cf-5562-86a7-8c281c1fad84, skipping ID generation
2026-01-28 20:07:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 282fed8d-c4cf-5562-86a7-8c281c1fad84 with scrape type 1
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 282fed8d-c4cf-5562-86a7-8c281c1fad84 from tracking dictionaries
2026-01-28 20:07:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 282fed8d-c4cf-5562-86a7-8c281c1fad84 sending to next pipeline
2026-01-28 20:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 282fed8d-c4cf-5562-86a7-8c281c1fad84, identifier: 1877979
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg not downloaded yet
2026-01-28 20:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 282fed8d-c4cf-5562-86a7-8c281c1fad84 with identifier: 1877979
2026-01-28 20:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 282fed8d-c4cf-5562-86a7-8c281c1fad84 with identifier: 1877979
2026-01-28 20:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 282fed8d-c4cf-5562-86a7-8c281c1fad84 with identifier: 1877979 to the API
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 108,
'color': 'GRIS ELECTROCLASH',
'currency': 'EUR',
'doors_number': 3,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '282fed8d-c4cf-5562-86a7-8c281c1fad84',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FIAT',
'model': '500',
'odometer': 34010,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 583195,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 577927,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 412826,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380689,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317030,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320493,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_282fed8d-c4cf-5562-86a7-8c281c1fad84/282fed8d-c4cf-5562-86a7-8c281c1fad84_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 235691,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/2b7ff13c4c9947188fe8cca8c2e7b825/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-16',
'seats_number': 4,
'seller_name': None,
'title': 'FIAT 500 500 1.0 70ch BSG S&S Pack Confort',
'transmission': 'manual',
'trim': '500 1.0 70ch BSG S&S Pack Confort',
'vin': None,
'year': 2023}
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877979%27 HTTP/1.1" 200 None
2026-01-28 20:07:33 [ayvens.fr] INFO: Saving data for 1877979: {'created_time': 1769630853.6001, 'last_price_update_time': 1769630853.600115, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877979') HTTP/1.1" 204 0
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4155c50>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/2.jpg saved to cache
2026-01-28 20:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ac4d0>
2026-01-28 20:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/3.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg not downloaded yet
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46b5790>
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/4.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44eb3d0>
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/5.jpg saved to cache
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg not downloaded yet
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg not downloaded yet
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:34 [ayvens.fr] INFO: Found listing with ID: 1877982
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877982%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [ayvens.fr] INFO: Scrape type for 1877982: 1
2026-01-28 20:07:34 [ayvens.fr] INFO: Extracting data for car ID: 1877982
2026-01-28 20:07:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6fdfec5-a8ba-5db9-a251-7136d406fef9 with identifier: 1877982
2026-01-28 20:07:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fdfec5-a8ba-5db9-a251-7136d406fef9 with scrape type 1
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/1.jpg not downloaded yet
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/2.jpg not downloaded yet
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c432b150>
2026-01-28 20:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/6.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4304510>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4323250>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/7.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4588c50>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg saved to cache
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/3.jpg not downloaded yet
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c6fd0>
2026-01-28 20:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fez-%252Ff2091f316fd841c689b01a0d13f04431%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/8.jpg saved to cache
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a
2026-01-28 20:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a, skipping ID generation
2026-01-28 20:07:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a with scrape type 1
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a from tracking dictionaries
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a86ccad-d8b4-5d70-b0d4-5c36deec914a sending to next pipeline
2026-01-28 20:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a, identifier: 1877980
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41bbdd0>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg saved to cache
2026-01-28 20:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ee090>
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg saved to cache
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/4.jpg not downloaded yet
2026-01-28 20:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a with identifier: 1877980
2026-01-28 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a with identifier: 1877980
2026-01-28 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a spider: ayvens.fr
2026-01-28 20:07:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 6a86ccad-d8b4-5d70-b0d4-5c36deec914a due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 93,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '6a86ccad-d8b4-5d70-b0d4-5c36deec914a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 40070,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314526,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314259,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 307618,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 375511,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290961,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311080,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a86ccad-d8b4-5d70-b0d4-5c36deec914a/6a86ccad-d8b4-5d70-b0d4-5c36deec914a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548571,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ez-/f2091f316fd841c689b01a0d13f04431/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-08-06',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C3 C3 BlueHDi 75ch Feel S&S',
'transmission': 'manual',
'trim': 'C3 BlueHDi 75ch Feel S&S',
'vin': None,
'year': 2018}
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877980%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [ayvens.fr] INFO: Saving data for 1877980: {'created_time': 1769630857.282491, 'last_price_update_time': 1769630857.282504, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877980') HTTP/1.1" 204 0
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/5.jpg not downloaded yet
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c443c250>
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg saved to cache
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/6.jpg not downloaded yet
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/7.jpg not downloaded yet
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b3dd0>
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41db890>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ed890>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgm-%252Fb199026e23ac4766a759820fb7428400%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg saved to cache
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2
2026-01-28 20:07:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b6f9bed9-f474-5af0-979e-f74eaaeffbb2, skipping ID generation
2026-01-28 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2 with scrape type 1
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b6f9bed9-f474-5af0-979e-f74eaaeffbb2 from tracking dictionaries
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b6f9bed9-f474-5af0-979e-f74eaaeffbb2 sending to next pipeline
2026-01-28 20:07:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b6f9bed9-f474-5af0-979e-f74eaaeffbb2, identifier: 1877981
2026-01-28 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b6f9bed9-f474-5af0-979e-f74eaaeffbb2 with identifier: 1877981
2026-01-28 20:07:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b6f9bed9-f474-5af0-979e-f74eaaeffbb2 with identifier: 1877981
2026-01-28 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'bleu eclipse', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c5 aircross', 'trim': 'c5 aircross puretech 130ch s&s shine pack eat8', 'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine pack eat8', 'price': 0, 'odometer': 87158, 'odometer_reading_unit': 'km', 'registration_date': '2023-02-21', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 149, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b6f9bed9-f474-5af0-979e-f74eaaeffbb2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 320703}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 320703}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 348558}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 314264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 297672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312271}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 209075}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'citroën c5 aircross', 'sanitized_make': 'citron', 'odometer_in_km': 87158}
Failed validating None in schema:
False
On instance:
{'age_in_months': 35,
'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'bleu eclipse',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'b6f9bed9-f474-5af0-979e-f74eaaeffbb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c5 aircross',
'model': 'c5 aircross',
'odometer': 87158,
'odometer_in_km': 87158,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-21',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine '
'pack eat8',
'transmission': 'automatic',
'trim': 'c5 aircross puretech 130ch s&s shine pack eat8',
'vin': None,
'year': 2023}
2026-01-28 20:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: b6f9bed9-f474-5af0-979e-f74eaaeffbb2 spider: ayvens.fr
2026-01-28 20:07:38 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: b6f9bed9-f474-5af0-979e-f74eaaeffbb2 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'bleu eclipse', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c5 aircross', 'trim': 'c5 aircross puretech 130ch s&s shine pack eat8', 'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine pack eat8', 'price': 0, 'odometer': 87158, 'odometer_reading_unit': 'km', 'registration_date': '2023-02-21', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 149, 'origin_country_code': 'fr', 'transmission': 'automatic', 'location': None, 'currency': 'eur', 'id': 'b6f9bed9-f474-5af0-979e-f74eaaeffbb2', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 320703}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 320703}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 348558}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 314264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 297672}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312271}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 242013}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 209075}], 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'citroën c5 aircross', 'sanitized_make': 'citron', 'odometer_in_km': 87158}
Failed validating None in schema:
False
On instance:
{'age_in_months': 35,
'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'bleu eclipse',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'b6f9bed9-f474-5af0-979e-f74eaaeffbb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c5 aircross',
'model': 'c5 aircross',
'odometer': 87158,
'odometer_in_km': 87158,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-21',
'sanitized_make': 'citron',
'seats_number': 5,
'seller_name': None,
'title': 'citroën c5 aircross c5 aircross puretech 130ch s&s shine '
'pack eat8',
'transmission': 'automatic',
'trim': 'c5 aircross puretech 130ch s&s shine pack eat8',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 149,
'color': 'BLEU ECLIPSE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'b6f9bed9-f474-5af0-979e-f74eaaeffbb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C5 AIRCROSS',
'odometer': 87158,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 320703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348558,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297672,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312271,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 242013,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b6f9bed9-f474-5af0-979e-f74eaaeffbb2/b6f9bed9-f474-5af0-979e-f74eaaeffbb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 209075,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gm-/b199026e23ac4766a759820fb7428400/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-02-21',
'seats_number': 5,
'seller_name': None,
'title': 'CITROËN C5 AIRCROSS C5 Aircross PureTech 130ch S&S Shine Pack EAT8',
'transmission': 'automatic',
'trim': 'C5 Aircross PureTech 130ch S&S Shine Pack EAT8',
'vin': None,
'year': 2023}
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877981%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [ayvens.fr] INFO: Saving data for 1877981: {'created_time': 1769630858.88438, 'last_price_update_time': 1769630858.884391, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877981') HTTP/1.1" 204 0
2026-01-28 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/8.jpg not downloaded yet
2026-01-28 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:38 [ayvens.fr] INFO: Found listing with ID: 1877983
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877983%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [ayvens.fr] INFO: Scrape type for 1877983: 1
2026-01-28 20:07:38 [ayvens.fr] INFO: Extracting data for car ID: 1877983
2026-01-28 20:07:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e173f779-e16e-50de-ac43-b0de3d0d2027 with identifier: 1877983
2026-01-28 20:07:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e173f779-e16e-50de-ac43-b0de3d0d2027 with scrape type 1
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/1.jpg not downloaded yet
2026-01-28 20:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c46e7990>
2026-01-28 20:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/1.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/2.jpg not downloaded yet
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/3.jpg not downloaded yet
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4257cd0>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/2.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b1290>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/3.jpg saved to cache
2026-01-28 20:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ee590>
2026-01-28 20:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/4.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/4.jpg not downloaded yet
2026-01-28 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/5.jpg not downloaded yet
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfae5450>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/5.jpg saved to cache
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/6.jpg not downloaded yet
2026-01-28 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/7.jpg not downloaded yet
2026-01-28 20:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d2190>
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/7.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c48d0>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/6.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/8.jpg not downloaded yet
2026-01-28 20:07:41 [ayvens.fr] INFO: Found listing with ID: 1877984
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877984%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [ayvens.fr] INFO: Scrape type for 1877984: 1
2026-01-28 20:07:41 [ayvens.fr] INFO: Extracting data for car ID: 1877984
2026-01-28 20:07:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b2ce95a-256f-5e21-831f-9145f088cd58 with identifier: 1877984
2026-01-28 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ce95a-256f-5e21-831f-9145f088cd58 with scrape type 1
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg not downloaded yet
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45bb5d0>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F938eeaa6fda24ef58ab5eb45e5df1b8a%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/8.jpg saved to cache
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a6fdfec5-a8ba-5db9-a251-7136d406fef9
2026-01-28 20:07:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a6fdfec5-a8ba-5db9-a251-7136d406fef9, skipping ID generation
2026-01-28 20:07:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fdfec5-a8ba-5db9-a251-7136d406fef9 with scrape type 1
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a6fdfec5-a8ba-5db9-a251-7136d406fef9 from tracking dictionaries
2026-01-28 20:07:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a6fdfec5-a8ba-5db9-a251-7136d406fef9 sending to next pipeline
2026-01-28 20:07:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a6fdfec5-a8ba-5db9-a251-7136d406fef9, identifier: 1877982
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4204f50>
2026-01-28 20:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/1.jpg saved to cache
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg not downloaded yet
2026-01-28 20:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a6fdfec5-a8ba-5db9-a251-7136d406fef9 with identifier: 1877982
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a6fdfec5-a8ba-5db9-a251-7136d406fef9 with identifier: 1877982
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
2026-01-28 20:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: a6fdfec5-a8ba-5db9-a251-7136d406fef9 spider: ayvens.fr
2026-01-28 20:07:42 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: a6fdfec5-a8ba-5db9-a251-7136d406fef9 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'jumpy' containing 'jumpy'
{'auction_title': '',
'c_o_2_emission_value': 138,
'color': 'BLANC',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'a6fdfec5-a8ba-5db9-a251-7136d406fef9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'JUMPY',
'odometer': 179276,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 422064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 369222,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 258337,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 262209,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 272657,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 252450,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a6fdfec5-a8ba-5db9-a251-7136d406fef9/a6fdfec5-a8ba-5db9-a251-7136d406fef9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354126,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/938eeaa6fda24ef58ab5eb45e5df1b8a/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-10',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN JUMPY Jumpy Fg M 2.0 BlueHDi 120ch S&S Driver',
'transmission': 'manual',
'trim': 'Jumpy Fg M 2.0 BlueHDi 120ch S&S Driver',
'vin': None,
'year': 2020}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877982%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [ayvens.fr] INFO: Saving data for 1877982: {'created_time': 1769630862.398537, 'last_price_update_time': 1769630862.398549, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877982') HTTP/1.1" 204 0
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg not downloaded yet
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e30d0>
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/2.jpg saved to cache
2026-01-28 20:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfaef2d0>
2026-01-28 20:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/3.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg not downloaded yet
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c443d2d0>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/4.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454c750>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/5.jpg saved to cache
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg not downloaded yet
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg not downloaded yet
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c5f347d0>
2026-01-28 20:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/6.jpg saved to cache
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg not downloaded yet
2026-01-28 20:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg not downloaded yet
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff15a90>
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/7.jpg saved to cache
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4161850>
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F35dd918ae25e4af89321bd41744f8149%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/8.jpg saved to cache
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e173f779-e16e-50de-ac43-b0de3d0d2027
2026-01-28 20:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e173f779-e16e-50de-ac43-b0de3d0d2027, skipping ID generation
2026-01-28 20:07:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e173f779-e16e-50de-ac43-b0de3d0d2027 with scrape type 1
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Removing item e173f779-e16e-50de-ac43-b0de3d0d2027 from tracking dictionaries
2026-01-28 20:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e173f779-e16e-50de-ac43-b0de3d0d2027 sending to next pipeline
2026-01-28 20:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: e173f779-e16e-50de-ac43-b0de3d0d2027, identifier: 1877983
2026-01-28 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:45 [ayvens.fr] INFO: Found listing with ID: 1877985
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877985%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [ayvens.fr] INFO: Scrape type for 1877985: 1
2026-01-28 20:07:45 [ayvens.fr] INFO: Extracting data for car ID: 1877985
2026-01-28 20:07:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 with identifier: 1877985
2026-01-28 20:07:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 with scrape type 1
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg not downloaded yet
2026-01-28 20:07:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: e173f779-e16e-50de-ac43-b0de3d0d2027 with identifier: 1877983
2026-01-28 20:07:45 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: e173f779-e16e-50de-ac43-b0de3d0d2027 with identifier: 1877983
2026-01-28 20:07:45 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: e173f779-e16e-50de-ac43-b0de3d0d2027 with identifier: 1877983 to the API
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 142,
'color': 'GRIS ASCOT',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'e173f779-e16e-50de-ac43-b0de3d0d2027',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'T-CROSS',
'odometer': 129526,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 428574,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397775,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 354572,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326513,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 349353,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346451,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e173f779-e16e-50de-ac43-b0de3d0d2027/e173f779-e16e-50de-ac43-b0de3d0d2027_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 306251,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/35dd918ae25e4af89321bd41744f8149/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-10-31',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN T-CROSS T-Cross 1.0 TSI 110ch Life Plus DSG7',
'transmission': 'automatic',
'trim': 'T-Cross 1.0 TSI 110ch Life Plus DSG7',
'vin': None,
'year': 2023}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877983%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [ayvens.fr] INFO: Saving data for 1877983: {'created_time': 1769630865.396003, 'last_price_update_time': 1769630865.396012, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877983') HTTP/1.1" 204 0
2026-01-28 20:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg not downloaded yet
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b4790>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg saved to cache
2026-01-28 20:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff54b10>
2026-01-28 20:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg not downloaded yet
2026-01-28 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg not downloaded yet
2026-01-28 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41c7450>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg not downloaded yet
2026-01-28 20:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg not downloaded yet
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e4990>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4322910>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg saved to cache
2026-01-28 20:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e50d0>
2026-01-28 20:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg saved to cache
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4321210>
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg saved to cache
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg not downloaded yet
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c405aa10>
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fes-%252Fd41b030f020847118ea08f399013638e%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg saved to cache
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b2ce95a-256f-5e21-831f-9145f088cd58
2026-01-28 20:07:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b2ce95a-256f-5e21-831f-9145f088cd58, skipping ID generation
2026-01-28 20:07:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b2ce95a-256f-5e21-831f-9145f088cd58 with scrape type 1
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 0b2ce95a-256f-5e21-831f-9145f088cd58 from tracking dictionaries
2026-01-28 20:07:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b2ce95a-256f-5e21-831f-9145f088cd58 sending to next pipeline
2026-01-28 20:07:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 0b2ce95a-256f-5e21-831f-9145f088cd58, identifier: 1877984
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg not downloaded yet
2026-01-28 20:07:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 0b2ce95a-256f-5e21-831f-9145f088cd58 with identifier: 1877984
2026-01-28 20:07:48 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 0b2ce95a-256f-5e21-831f-9145f088cd58 with identifier: 1877984
2026-01-28 20:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris aluminium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 110ch allure business s&s 5p', 'title': 'peugeot 208 208 1.2 puretech 110ch allure business s&s 5p', 'price': 0, 'odometer': 15786, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-29', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 99, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0b2ce95a-256f-5e21-831f-9145f088cd58', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 512328}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 512328}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 550132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 355586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 397285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 302520}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 386396}], 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 15786}
Failed validating None in schema:
False
On instance:
{'age_in_months': 97,
'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'gris aluminium',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '0b2ce95a-256f-5e21-831f-9145f088cd58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 15786,
'odometer_in_km': 15786,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 110ch allure business s&s 5p',
'transmission': 'manual',
'trim': '208 1.2 puretech 110ch allure business s&s 5p',
'vin': None,
'year': 2017}
2026-01-28 20:07:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 0b2ce95a-256f-5e21-831f-9145f088cd58 spider: ayvens.fr
2026-01-28 20:07:48 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 0b2ce95a-256f-5e21-831f-9145f088cd58 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris aluminium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208', 'trim': '208 1.2 puretech 110ch allure business s&s 5p', 'title': 'peugeot 208 208 1.2 puretech 110ch allure business s&s 5p', 'price': 0, 'odometer': 15786, 'odometer_reading_unit': 'km', 'registration_date': '2017-11-29', 'year': 2017, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 99, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '0b2ce95a-256f-5e21-831f-9145f088cd58', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 512328}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 512328}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 550132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 355586}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 397285}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 302520}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 386396}], 'current_year_diff': 9, 'age_in_months': 97, 'make_model': 'peugeot 208', 'sanitized_make': 'peugeot', 'odometer_in_km': 15786}
Failed validating None in schema:
False
On instance:
{'age_in_months': 97,
'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'gris aluminium',
'currency': 'eur',
'current_year_diff': 9,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '0b2ce95a-256f-5e21-831f-9145f088cd58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208',
'model': '208',
'odometer': 15786,
'odometer_in_km': 15786,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 208 1.2 puretech 110ch allure business s&s 5p',
'transmission': 'manual',
'trim': '208 1.2 puretech 110ch allure business s&s 5p',
'vin': None,
'year': 2017}
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': 'GRIS ALUMINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '0b2ce95a-256f-5e21-831f-9145f088cd58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208',
'odometer': 15786,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 512328,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 550132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 355586,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397285,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 302520,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b2ce95a-256f-5e21-831f-9145f088cd58/0b2ce95a-256f-5e21-831f-9145f088cd58_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 386396,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/es-/d41b030f020847118ea08f399013638e/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-11-29',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 208 1.2 PureTech 110ch Allure Business S&S 5p',
'transmission': 'manual',
'trim': '208 1.2 PureTech 110ch Allure Business S&S 5p',
'vin': None,
'year': 2017}
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877984%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [ayvens.fr] INFO: Saving data for 1877984: {'created_time': 1769630868.338503, 'last_price_update_time': 1769630868.338517, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877984') HTTP/1.1" 204 0
2026-01-28 20:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:48 [ayvens.fr] INFO: Found listing with ID: 1877986
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877986%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [ayvens.fr] INFO: Scrape type for 1877986: 1
2026-01-28 20:07:48 [ayvens.fr] INFO: Extracting data for car ID: 1877986
2026-01-28 20:07:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8a55a27-0423-5610-aaa5-c341066fa9c2 with identifier: 1877986
2026-01-28 20:07:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a55a27-0423-5610-aaa5-c341066fa9c2 with scrape type 1
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/1.jpg not downloaded yet
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4349c50>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg saved to cache
2026-01-28 20:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44669d0>
2026-01-28 20:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/2.jpg not downloaded yet
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42bec50>
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/3.jpg not downloaded yet
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/4.jpg not downloaded yet
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4465d90>
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg saved to cache
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/5.jpg not downloaded yet
2026-01-28 20:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/6.jpg not downloaded yet
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d1ad0>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c455cfd0>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412a410>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg saved to cache
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/7.jpg not downloaded yet
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41d9d10>
2026-01-28 20:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffb-%252F77d373860db64aac94d005dd7b81eaf5%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg saved to cache
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56
2026-01-28 20:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56, skipping ID generation
2026-01-28 20:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 with scrape type 1
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 from tracking dictionaries
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 sending to next pipeline
2026-01-28 20:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56, identifier: 1877985
2026-01-28 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/8.jpg not downloaded yet
2026-01-28 20:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 with identifier: 1877985
2026-01-28 20:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 with identifier: 1877985
2026-01-28 20:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': None, 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'grand c4 spacetourer', 'trim': 'grand c4 spacetourer puretech 130ch s&s business e6.d-temp', 'title': 'citroën grand c4 spacetourer grand c4 spacetourer puretech 130ch s&s business e6.d-temp', 'price': 0, 'odometer': 89325, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-15', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 114, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329912}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 314627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 327721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 280552}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 210064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 198197}], 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'citroën grand c4 spacetourer', 'sanitized_make': 'citron', 'odometer_in_km': 89325}
Failed validating None in schema:
False
On instance:
{'age_in_months': 87,
'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën grand c4 spacetourer',
'model': 'grand c4 spacetourer',
'odometer': 89325,
'odometer_in_km': 89325,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-15',
'sanitized_make': 'citron',
'seats_number': 7,
'seller_name': None,
'title': 'citroën grand c4 spacetourer grand c4 spacetourer puretech '
'130ch s&s business e6.d-temp',
'transmission': 'manual',
'trim': 'grand c4 spacetourer puretech 130ch s&s business e6.d-temp',
'vin': None,
'year': 2018}
2026-01-28 20:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 spider: ayvens.fr
2026-01-28 20:07:51 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': None, 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'grand c4 spacetourer', 'trim': 'grand c4 spacetourer puretech 130ch s&s business e6.d-temp', 'title': 'citroën grand c4 spacetourer grand c4 spacetourer puretech 130ch s&s business e6.d-temp', 'price': 0, 'odometer': 89325, 'odometer_reading_unit': 'km', 'registration_date': '2018-10-15', 'year': 2018, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 7, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 114, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 301112}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 329912}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 314627}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 327721}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 280552}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 210064}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 198197}], 'current_year_diff': 8, 'age_in_months': 87, 'make_model': 'citroën grand c4 spacetourer', 'sanitized_make': 'citron', 'odometer_in_km': 89325}
Failed validating None in schema:
False
On instance:
{'age_in_months': 87,
'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'eur',
'current_year_diff': 8,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën grand c4 spacetourer',
'model': 'grand c4 spacetourer',
'odometer': 89325,
'odometer_in_km': 89325,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-15',
'sanitized_make': 'citron',
'seats_number': 7,
'seller_name': None,
'title': 'citroën grand c4 spacetourer grand c4 spacetourer puretech '
'130ch s&s business e6.d-temp',
'transmission': 'manual',
'trim': 'grand c4 spacetourer puretech 130ch s&s business e6.d-temp',
'vin': None,
'year': 2018}
{'auction_title': '',
'c_o_2_emission_value': 114,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'GRAND C4 SPACETOURER',
'odometer': 89325,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 301112,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329912,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314627,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 327721,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 280552,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 210064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56/f6e1152d-0a4a-5c2c-9ca4-a36aff0bfd56_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198197,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fb-/77d373860db64aac94d005dd7b81eaf5/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-10-15',
'seats_number': 7,
'seller_name': None,
'title': 'CITROËN GRAND C4 SPACETOURER Grand C4 SpaceTourer PureTech 130ch '
'S&S Business E6.d-TEMP',
'transmission': 'manual',
'trim': 'Grand C4 SpaceTourer PureTech 130ch S&S Business E6.d-TEMP',
'vin': None,
'year': 2018}
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877985%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [ayvens.fr] INFO: Saving data for 1877985: {'created_time': 1769630871.475865, 'last_price_update_time': 1769630871.475876, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877985') HTTP/1.1" 204 0
2026-01-28 20:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:51 [ayvens.fr] INFO: Found listing with ID: 1877987
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877987%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [ayvens.fr] INFO: Scrape type for 1877987: 1
2026-01-28 20:07:51 [ayvens.fr] INFO: Extracting data for car ID: 1877987
2026-01-28 20:07:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab2217da-02cf-5d1c-8411-e7e0795041f2 with identifier: 1877987
2026-01-28 20:07:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2217da-02cf-5d1c-8411-e7e0795041f2 with scrape type 1
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/1.jpg not downloaded yet
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43e3710>
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/2.jpg saved to cache
2026-01-28 20:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff29ad0>
2026-01-28 20:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/1.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/2.jpg not downloaded yet
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/3.jpg not downloaded yet
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418c890>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/4.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/4.jpg not downloaded yet
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/5.jpg not downloaded yet
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c412b610>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/3.jpg saved to cache
2026-01-28 20:07:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4306110>
2026-01-28 20:07:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/5.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/6.jpg not downloaded yet
2026-01-28 20:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/7.jpg not downloaded yet
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4466710>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/6.jpg saved to cache
2026-01-28 20:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43c0490>
2026-01-28 20:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/7.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/8.jpg not downloaded yet
2026-01-28 20:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b6c10>
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgh-%252Fdc36b4509f4f448184cfa99cd8b2a2ca%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/8.jpg saved to cache
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b8a55a27-0423-5610-aaa5-c341066fa9c2
2026-01-28 20:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b8a55a27-0423-5610-aaa5-c341066fa9c2, skipping ID generation
2026-01-28 20:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8a55a27-0423-5610-aaa5-c341066fa9c2 with scrape type 1
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Removing item b8a55a27-0423-5610-aaa5-c341066fa9c2 from tracking dictionaries
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b8a55a27-0423-5610-aaa5-c341066fa9c2 sending to next pipeline
2026-01-28 20:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: b8a55a27-0423-5610-aaa5-c341066fa9c2, identifier: 1877986
2026-01-28 20:07:54 [ayvens.fr] INFO: Found listing with ID: 1877988
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877988%27 HTTP/1.1" 200 None
2026-01-28 20:07:54 [ayvens.fr] INFO: Scrape type for 1877988: 1
2026-01-28 20:07:54 [ayvens.fr] INFO: Extracting data for car ID: 1877988
2026-01-28 20:07:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 178eba1a-1925-5674-a40d-e761ddf3c512 with identifier: 1877988
2026-01-28 20:07:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178eba1a-1925-5674-a40d-e761ddf3c512 with scrape type 1
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/1.jpg not downloaded yet
2026-01-28 20:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: b8a55a27-0423-5610-aaa5-c341066fa9c2 with identifier: 1877986
2026-01-28 20:07:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: b8a55a27-0423-5610-aaa5-c341066fa9c2 with identifier: 1877986
2026-01-28 20:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: b8a55a27-0423-5610-aaa5-c341066fa9c2 with identifier: 1877986 to the API
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'DARK NIGHT METAL',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': 'b8a55a27-0423-5610-aaa5-c341066fa9c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 128280,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 384877,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 429139,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253026,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 319701,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 304823,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 287061,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b8a55a27-0423-5610-aaa5-c341066fa9c2/b8a55a27-0423-5610-aaa5-c341066fa9c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 323065,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gh-/dc36b4509f4f448184cfa99cd8b2a2ca/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-07-27',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'vin': None,
'year': 2022}
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877986%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [ayvens.fr] INFO: Saving data for 1877986: {'created_time': 1769630875.10144, 'last_price_update_time': 1769630875.101455, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877986') HTTP/1.1" 204 0
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/2.jpg not downloaded yet
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44e8e50>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/1.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/3.jpg not downloaded yet
2026-01-28 20:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/4.jpg not downloaded yet
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff54210>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/3.jpg saved to cache
2026-01-28 20:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c6890>
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/2.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c458a610>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/5.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/5.jpg not downloaded yet
2026-01-28 20:07:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/6.jpg not downloaded yet
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4206690>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/4.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1b6090>
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/6.jpg saved to cache
2026-01-28 20:07:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/7.jpg not downloaded yet
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f9910>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/7.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c434b290>
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F0a6e49e8378d402e8584158dc9bbe50c%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/8.jpg saved to cache
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ab2217da-02cf-5d1c-8411-e7e0795041f2
2026-01-28 20:07:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ab2217da-02cf-5d1c-8411-e7e0795041f2, skipping ID generation
2026-01-28 20:07:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab2217da-02cf-5d1c-8411-e7e0795041f2 with scrape type 1
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ab2217da-02cf-5d1c-8411-e7e0795041f2 from tracking dictionaries
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ab2217da-02cf-5d1c-8411-e7e0795041f2 sending to next pipeline
2026-01-28 20:07:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: ab2217da-02cf-5d1c-8411-e7e0795041f2, identifier: 1877987
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/8.jpg not downloaded yet
2026-01-28 20:07:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: ab2217da-02cf-5d1c-8411-e7e0795041f2 with identifier: 1877987
2026-01-28 20:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: ab2217da-02cf-5d1c-8411-e7e0795041f2 with identifier: 1877987
2026-01-28 20:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
2026-01-28 20:07:57 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: ab2217da-02cf-5d1c-8411-e7e0795041f2 spider: ayvens.fr
2026-01-28 20:07:57 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: ab2217da-02cf-5d1c-8411-e7e0795041f2 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'citroën' containing 'citroën' and model 'berlingo' containing 'berlingo'
{'auction_title': '',
'c_o_2_emission_value': 0,
'color': 'BLANC BANQUISE',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'electric',
'id': 'ab2217da-02cf-5d1c-8411-e7e0795041f2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'BERLINGO',
'odometer': 19796,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 537507,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402583,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 453137,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 360406,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 325839,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250121,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ab2217da-02cf-5d1c-8411-e7e0795041f2/ab2217da-02cf-5d1c-8411-e7e0795041f2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387819,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/0a6e49e8378d402e8584158dc9bbe50c/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-12-10',
'seats_number': 3,
'seller_name': None,
'title': 'CITROËN BERLINGO Berlingo E-Berlingo M Club',
'transmission': 'automatic',
'trim': 'Berlingo E-Berlingo M Club',
'vin': None,
'year': 2019}
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877987%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [ayvens.fr] INFO: Saving data for 1877987: {'created_time': 1769630878.020126, 'last_price_update_time': 1769630878.020139, 'auction_closing_time': 1769695200.0}
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877987') HTTP/1.1" 204 0
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [ayvens.fr] INFO: Found listing with ID: 1877989
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877989%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [ayvens.fr] INFO: Scrape type for 1877989: 1
2026-01-28 20:07:58 [ayvens.fr] INFO: Extracting data for car ID: 1877989
2026-01-28 20:07:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64c4e419-ccb3-59e8-a5fb-986ec77bc410 with identifier: 1877989
2026-01-28 20:07:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410 with scrape type 1
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/1.jpg not downloaded yet
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/2.jpg not downloaded yet
2026-01-28 20:07:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/3.jpg not downloaded yet
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/4.jpg not downloaded yet
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c454c850>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/4.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/5.jpg not downloaded yet
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/6.jpg not downloaded yet
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c443f290>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/1.jpg saved to cache
2026-01-28 20:07:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a5790>
2026-01-28 20:07:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/2.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c414d910>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/3.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4282a90>
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:07:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/5.jpg saved to cache
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/7.jpg not downloaded yet
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/8.jpg not downloaded yet
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [ayvens.fr] INFO: Found listing with ID: 1877990
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877990%27 HTTP/1.1" 200 None
2026-01-28 20:07:59 [ayvens.fr] INFO: Scrape type for 1877990: 1
2026-01-28 20:07:59 [ayvens.fr] INFO: Extracting data for car ID: 1877990
2026-01-28 20:07:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98fc518b-0f78-55d9-bd27-a72682d95e7f with identifier: 1877990
2026-01-28 20:07:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fc518b-0f78-55d9-bd27-a72682d95e7f with scrape type 1
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:07:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:07:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg not downloaded yet
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:07:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg not downloaded yet
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg not downloaded yet
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4418910>
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/6.jpg saved to cache
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4320950>
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/7.jpg saved to cache
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg not downloaded yet
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419e890>
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/2.jpg saved to cache
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg not downloaded yet
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4380b10>
2026-01-28 20:08:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgt-%252Fa430678974fe4b7ba8c99501c1218e6b%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/8.jpg saved to cache
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 178eba1a-1925-5674-a40d-e761ddf3c512
2026-01-28 20:08:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 178eba1a-1925-5674-a40d-e761ddf3c512, skipping ID generation
2026-01-28 20:08:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 178eba1a-1925-5674-a40d-e761ddf3c512 with scrape type 1
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 178eba1a-1925-5674-a40d-e761ddf3c512 from tracking dictionaries
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 178eba1a-1925-5674-a40d-e761ddf3c512 sending to next pipeline
2026-01-28 20:08:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 178eba1a-1925-5674-a40d-e761ddf3c512, identifier: 1877988
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf142310>
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/1.jpg saved to cache
2026-01-28 20:08:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a7910>
2026-01-28 20:08:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/3.jpg saved to cache
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff29450>
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/4.jpg saved to cache
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 178eba1a-1925-5674-a40d-e761ddf3c512 with identifier: 1877988
2026-01-28 20:08:02 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 178eba1a-1925-5674-a40d-e761ddf3c512 with identifier: 1877988
2026-01-28 20:08:02 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 178eba1a-1925-5674-a40d-e761ddf3c512 with identifier: 1877988 to the API
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 121,
'color': 'GRIS MAGN',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '178eba1a-1925-5674-a40d-e761ddf3c512',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'SEAT',
'model': 'LEON ST',
'odometer': 79721,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 522647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395069,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 289680,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352808,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 303805,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 253635,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_178eba1a-1925-5674-a40d-e761ddf3c512/178eba1a-1925-5674-a40d-e761ddf3c512_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 410644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gt-/a430678974fe4b7ba8c99501c1218e6b/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-15',
'seats_number': 5,
'seller_name': None,
'title': 'SEAT LEON ST Leon ST 2.0 TDI 150ch Style Business DSG7',
'transmission': 'automatic',
'trim': 'Leon ST 2.0 TDI 150ch Style Business DSG7',
'vin': None,
'year': 2023}
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877988%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [ayvens.fr] INFO: Saving data for 1877988: {'created_time': 1769630882.750925, 'last_price_update_time': 1769630882.750936, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877988') HTTP/1.1" 204 0
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg not downloaded yet
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg not downloaded yet
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg not downloaded yet
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:02 [ayvens.fr] INFO: Found listing with ID: 1877991
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877991%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [ayvens.fr] INFO: Scrape type for 1877991: 1
2026-01-28 20:08:02 [ayvens.fr] INFO: Extracting data for car ID: 1877991
2026-01-28 20:08:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 923f27de-daf2-5584-9942-9d4111517464 with identifier: 1877991
2026-01-28 20:08:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923f27de-daf2-5584-9942-9d4111517464 with scrape type 1
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg not downloaded yet
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg not downloaded yet
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43931d0>
2026-01-28 20:08:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/5.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4336190>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/6.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d0890>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/7.jpg saved to cache
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg not downloaded yet
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4085b50>
2026-01-28 20:08:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffv-%252F5096f3326ade412196f4022c91cba863%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/8.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410
2026-01-28 20:08:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64c4e419-ccb3-59e8-a5fb-986ec77bc410, skipping ID generation
2026-01-28 20:08:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410 with scrape type 1
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 64c4e419-ccb3-59e8-a5fb-986ec77bc410 from tracking dictionaries
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64c4e419-ccb3-59e8-a5fb-986ec77bc410 sending to next pipeline
2026-01-28 20:08:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 64c4e419-ccb3-59e8-a5fb-986ec77bc410, identifier: 1877989
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg not downloaded yet
2026-01-28 20:08:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 64c4e419-ccb3-59e8-a5fb-986ec77bc410 with identifier: 1877989
2026-01-28 20:08:04 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 64c4e419-ccb3-59e8-a5fb-986ec77bc410 with identifier: 1877989
2026-01-28 20:08:04 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 64c4e419-ccb3-59e8-a5fb-986ec77bc410 with identifier: 1877989 to the API
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 119,
'color': 'GRIS MAGNETIC',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '64c4e419-ccb3-59e8-a5fb-986ec77bc410',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'FORD',
'model': 'PUMA',
'odometer': 88525,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 321135,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344644,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 326563,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 356296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310850,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 239192,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64c4e419-ccb3-59e8-a5fb-986ec77bc410/64c4e419-ccb3-59e8-a5fb-986ec77bc410_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 385383,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fv-/5096f3326ade412196f4022c91cba863/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-11-09',
'seats_number': 5,
'seller_name': None,
'title': 'FORD PUMA Puma 1.5 EcoBlue 120ch Titanium',
'transmission': 'manual',
'trim': 'Puma 1.5 EcoBlue 120ch Titanium',
'vin': None,
'year': 2020}
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877989%27 HTTP/1.1" 200 None
2026-01-28 20:08:04 [ayvens.fr] INFO: Saving data for 1877989: {'created_time': 1769630884.620921, 'last_price_update_time': 1769630884.620935, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877989') HTTP/1.1" 204 0
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c6c74f10>
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg saved to cache
2026-01-28 20:08:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4230bd0>
2026-01-28 20:08:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1ec7d0>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg not downloaded yet
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg not downloaded yet
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg not downloaded yet
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg not downloaded yet
2026-01-28 20:08:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:05 [ayvens.fr] INFO: Found listing with ID: 1877992
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877992%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [ayvens.fr] INFO: Scrape type for 1877992: 1
2026-01-28 20:08:05 [ayvens.fr] INFO: Extracting data for car ID: 1877992
2026-01-28 20:08:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf44c853-436c-5436-b882-8dc11ec367e8 with identifier: 1877992
2026-01-28 20:08:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf44c853-436c-5436-b882-8dc11ec367e8 with scrape type 1
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/1.jpg not downloaded yet
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4315150>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg saved to cache
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/2.jpg not downloaded yet
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41aebd0>
2026-01-28 20:08:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44dd590>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ac6d0>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg saved to cache
2026-01-28 20:08:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435d050>
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252F4f88260af4144d3c94a6247921967589%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98fc518b-0f78-55d9-bd27-a72682d95e7f
2026-01-28 20:08:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98fc518b-0f78-55d9-bd27-a72682d95e7f, skipping ID generation
2026-01-28 20:08:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 98fc518b-0f78-55d9-bd27-a72682d95e7f with scrape type 1
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 98fc518b-0f78-55d9-bd27-a72682d95e7f from tracking dictionaries
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98fc518b-0f78-55d9-bd27-a72682d95e7f sending to next pipeline
2026-01-28 20:08:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 98fc518b-0f78-55d9-bd27-a72682d95e7f, identifier: 1877990
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/3.jpg not downloaded yet
2026-01-28 20:08:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 98fc518b-0f78-55d9-bd27-a72682d95e7f with identifier: 1877990
2026-01-28 20:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 98fc518b-0f78-55d9-bd27-a72682d95e7f with identifier: 1877990
2026-01-28 20:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav', 'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav', 'price': 0, 'odometer': 94757, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-18', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 110, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '98fc518b-0f78-55d9-bd27-a72682d95e7f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 392915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335958}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 318762}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 351050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 237278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 333021}], 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 94757}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '98fc518b-0f78-55d9-bd27-a72682d95e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 94757,
'odometer_in_km': 94757,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav',
'vin': None,
'year': 2019}
2026-01-28 20:08:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 98fc518b-0f78-55d9-bd27-a72682d95e7f spider: ayvens.fr
2026-01-28 20:08:07 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 98fc518b-0f78-55d9-bd27-a72682d95e7f due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav', 'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav', 'price': 0, 'odometer': 94757, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-18', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 110, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '98fc518b-0f78-55d9-bd27-a72682d95e7f', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 409018}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 392915}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 335958}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 318762}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 351050}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 237278}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 333021}], 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 94757}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '98fc518b-0f78-55d9-bd27-a72682d95e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 94757,
'odometer_in_km': 94757,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '98fc518b-0f78-55d9-bd27-a72682d95e7f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 94757,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 409018,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 392915,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 335958,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 318762,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351050,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 237278,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98fc518b-0f78-55d9-bd27-a72682d95e7f/98fc518b-0f78-55d9-bd27-a72682d95e7f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 333021,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/4f88260af4144d3c94a6247921967589/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.2 PureTech 82ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.2 PureTech 82ch S&S Feel Nav',
'vin': None,
'year': 2019}
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877990%27 HTTP/1.1" 200 None
2026-01-28 20:08:07 [ayvens.fr] INFO: Saving data for 1877990: {'created_time': 1769630887.477128, 'last_price_update_time': 1769630887.477141, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877990') HTTP/1.1" 204 0
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40961d0>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg saved to cache
2026-01-28 20:08:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4359bd0>
2026-01-28 20:08:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg saved to cache
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/4.jpg not downloaded yet
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/5.jpg not downloaded yet
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/6.jpg not downloaded yet
2026-01-28 20:08:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/7.jpg not downloaded yet
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/8.jpg not downloaded yet
2026-01-28 20:08:08 [ayvens.fr] INFO: Found listing with ID: 1877993
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877993%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [ayvens.fr] INFO: Scrape type for 1877993: 1
2026-01-28 20:08:08 [ayvens.fr] INFO: Extracting data for car ID: 1877993
2026-01-28 20:08:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4628f46c-08e4-57c4-b379-8b3e86336468 with identifier: 1877993
2026-01-28 20:08:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4628f46c-08e4-57c4-b379-8b3e86336468 with scrape type 1
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/1.jpg not downloaded yet
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/2.jpg not downloaded yet
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452a710>
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg saved to cache
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4280650>
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg saved to cache
2026-01-28 20:08:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ed910>
2026-01-28 20:08:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4464c50>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4206f10>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg saved to cache
2026-01-28 20:08:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418ca90>
2026-01-28 20:08:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fc745433ffce647068923f8a040bdad51%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 923f27de-daf2-5584-9942-9d4111517464
2026-01-28 20:08:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 923f27de-daf2-5584-9942-9d4111517464, skipping ID generation
2026-01-28 20:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 923f27de-daf2-5584-9942-9d4111517464 with scrape type 1
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 923f27de-daf2-5584-9942-9d4111517464 from tracking dictionaries
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 923f27de-daf2-5584-9942-9d4111517464 sending to next pipeline
2026-01-28 20:08:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 923f27de-daf2-5584-9942-9d4111517464, identifier: 1877991
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4589cd0>
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/1.jpg saved to cache
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/3.jpg not downloaded yet
2026-01-28 20:08:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 923f27de-daf2-5584-9942-9d4111517464 with identifier: 1877991
2026-01-28 20:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 923f27de-daf2-5584-9942-9d4111517464 with identifier: 1877991
2026-01-28 20:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav', 'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav', 'price': 0, 'odometer': 90000, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-18', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 110, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '923f27de-daf2-5584-9942-9d4111517464', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 425059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 425059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 416860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 395745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338656}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317418}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 298177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312303}], 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 90000}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '923f27de-daf2-5584-9942-9d4111517464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 90000,
'odometer_in_km': 90000,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338656,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav',
'vin': None,
'year': 2019}
2026-01-28 20:08:10 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 923f27de-daf2-5584-9942-9d4111517464 spider: ayvens.fr
2026-01-28 20:08:10 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 923f27de-daf2-5584-9942-9d4111517464 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'noir perla nera', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'citroën', 'model': 'c3', 'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav', 'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav', 'price': 0, 'odometer': 90000, 'odometer_reading_unit': 'km', 'registration_date': '2019-03-18', 'year': 2019, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 2, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 110, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '923f27de-daf2-5584-9942-9d4111517464', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 425059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 425059}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 416860}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 395745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 338656}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317418}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 298177}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 312303}], 'current_year_diff': 7, 'age_in_months': 82, 'make_model': 'citroën c3', 'sanitized_make': 'citron', 'odometer_in_km': 90000}
Failed validating None in schema:
False
On instance:
{'age_in_months': 82,
'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'noir perla nera',
'currency': 'eur',
'current_year_diff': 7,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '923f27de-daf2-5584-9942-9d4111517464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'citroën',
'make_model': 'citroën c3',
'model': 'c3',
'odometer': 90000,
'odometer_in_km': 90000,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338656,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'sanitized_make': 'citron',
'seats_number': 2,
'seller_name': None,
'title': 'citroën c3 c3 ste 1.2 puretech 82ch s&s feel nav',
'transmission': 'manual',
'trim': 'c3 ste 1.2 puretech 82ch s&s feel nav',
'vin': None,
'year': 2019}
{'auction_title': '',
'c_o_2_emission_value': 110,
'color': 'NOIR PERLA NERA',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '923f27de-daf2-5584-9942-9d4111517464',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'CITROËN',
'model': 'C3',
'odometer': 90000,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 425059,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416860,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 395745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 338656,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317418,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 298177,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_923f27de-daf2-5584-9942-9d4111517464/923f27de-daf2-5584-9942-9d4111517464_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 312303,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/c745433ffce647068923f8a040bdad51/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-18',
'seats_number': 2,
'seller_name': None,
'title': 'CITROËN C3 C3 Ste 1.2 PureTech 82ch S&S Feel Nav',
'transmission': 'manual',
'trim': 'C3 Ste 1.2 PureTech 82ch S&S Feel Nav',
'vin': None,
'year': 2019}
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877991%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [ayvens.fr] INFO: Saving data for 1877991: {'created_time': 1769630890.80479, 'last_price_update_time': 1769630890.804802, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877991') HTTP/1.1" 204 0
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/4.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/5.jpg not downloaded yet
2026-01-28 20:08:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/6.jpg not downloaded yet
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/7.jpg not downloaded yet
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/8.jpg not downloaded yet
2026-01-28 20:08:10 [ayvens.fr] INFO: Found listing with ID: 1877994
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877994%27 HTTP/1.1" 200 None
2026-01-28 20:08:10 [ayvens.fr] INFO: Scrape type for 1877994: 1
2026-01-28 20:08:10 [ayvens.fr] INFO: Extracting data for car ID: 1877994
2026-01-28 20:08:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 025ae2e1-11bc-5203-a817-34ba5efe2969 with identifier: 1877994
2026-01-28 20:08:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 025ae2e1-11bc-5203-a817-34ba5efe2969 with scrape type 1
2026-01-28 20:08:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/1.jpg not downloaded yet
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/2.jpg not downloaded yet
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c425f3d0>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/4.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4466550>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/6.jpg saved to cache
2026-01-28 20:08:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4128410>
2026-01-28 20:08:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/3.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4337290>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/2.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43370d0>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/7.jpg saved to cache
2026-01-28 20:08:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c462a790>
2026-01-28 20:08:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/8.jpg saved to cache
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4097850>
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgg-%252Ff6bb9e265850412e99a1a3291bdeccc6%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/5.jpg saved to cache
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf44c853-436c-5436-b882-8dc11ec367e8
2026-01-28 20:08:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf44c853-436c-5436-b882-8dc11ec367e8, skipping ID generation
2026-01-28 20:08:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf44c853-436c-5436-b882-8dc11ec367e8 with scrape type 1
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cf44c853-436c-5436-b882-8dc11ec367e8 from tracking dictionaries
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf44c853-436c-5436-b882-8dc11ec367e8 sending to next pipeline
2026-01-28 20:08:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: cf44c853-436c-5436-b882-8dc11ec367e8, identifier: 1877992
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/3.jpg not downloaded yet
2026-01-28 20:08:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: cf44c853-436c-5436-b882-8dc11ec367e8 with identifier: 1877992
2026-01-28 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: cf44c853-436c-5436-b882-8dc11ec367e8 with identifier: 1877992
2026-01-28 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:08:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: cf44c853-436c-5436-b882-8dc11ec367e8 spider: ayvens.fr
2026-01-28 20:08:13 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: cf44c853-436c-5436-b882-8dc11ec367e8 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 50,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.3L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'cf44c853-436c-5436-b882-8dc11ec367e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'VOLVO',
'model': 'XC40',
'odometer': 117320,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 446566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 452738,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 397173,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351666,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 296532,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 263512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf44c853-436c-5436-b882-8dc11ec367e8/cf44c853-436c-5436-b882-8dc11ec367e8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 279162,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gg-/f6bb9e265850412e99a1a3291bdeccc6/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-05-31',
'seats_number': 5,
'seller_name': None,
'title': 'VOLVO XC40 XC40 T5 Recharge 180 + 82ch R-Design DCT 7',
'transmission': 'automatic',
'trim': 'XC40 T5 Recharge 180 + 82ch R-Design DCT 7',
'vin': None,
'year': 2022}
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877992%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [ayvens.fr] INFO: Saving data for 1877992: {'created_time': 1769630893.721714, 'last_price_update_time': 1769630893.721725, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877992') HTTP/1.1" 204 0
2026-01-28 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/4.jpg not downloaded yet
2026-01-28 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/5.jpg not downloaded yet
2026-01-28 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/6.jpg not downloaded yet
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff55790>
2026-01-28 20:08:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/4.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/7.jpg not downloaded yet
2026-01-28 20:08:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417c7d0>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/5.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf142290>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/7.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40866d0>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/3.jpg saved to cache
2026-01-28 20:08:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41281d0>
2026-01-28 20:08:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/1.jpg saved to cache
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4391d90>
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/6.jpg saved to cache
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/8.jpg not downloaded yet
2026-01-28 20:08:15 [ayvens.fr] INFO: Found listing with ID: 1877995
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877995%27 HTTP/1.1" 200 None
2026-01-28 20:08:15 [ayvens.fr] INFO: Scrape type for 1877995: 1
2026-01-28 20:08:15 [ayvens.fr] INFO: Extracting data for car ID: 1877995
2026-01-28 20:08:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd7d2f7d-66bf-5fa3-967c-3f71bb014161 with identifier: 1877995
2026-01-28 20:08:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161 with scrape type 1
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/1.jpg not downloaded yet
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1421d0>
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/8.jpg saved to cache
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40cb790>
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fga-%252F4807a02a2a43427fb259ffb092ab3a3d%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/2.jpg saved to cache
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4628f46c-08e4-57c4-b379-8b3e86336468
2026-01-28 20:08:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4628f46c-08e4-57c4-b379-8b3e86336468, skipping ID generation
2026-01-28 20:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4628f46c-08e4-57c4-b379-8b3e86336468 with scrape type 1
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4628f46c-08e4-57c4-b379-8b3e86336468 from tracking dictionaries
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4628f46c-08e4-57c4-b379-8b3e86336468 sending to next pipeline
2026-01-28 20:08:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 4628f46c-08e4-57c4-b379-8b3e86336468, identifier: 1877993
2026-01-28 20:08:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 4628f46c-08e4-57c4-b379-8b3e86336468 with identifier: 1877993
2026-01-28 20:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 4628f46c-08e4-57c4-b379-8b3e86336468 with identifier: 1877993
2026-01-28 20:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:08:16 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 4628f46c-08e4-57c4-b379-8b3e86336468 spider: ayvens.fr
2026-01-28 20:08:16 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 4628f46c-08e4-57c4-b379-8b3e86336468 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 99,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '4628f46c-08e4-57c4-b379-8b3e86336468',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 83226,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 572978,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 548542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 370998,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 454048,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 430073,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 330704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4628f46c-08e4-57c4-b379-8b3e86336468/4628f46c-08e4-57c4-b379-8b3e86336468_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 433599,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/ga-/4807a02a2a43427fb259ffb092ab3a3d/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-06-18',
'seats_number': 5,
'seller_name': None,
'title': 'RENAULT CLIO Clio 1.6 E-Tech 140ch Business',
'transmission': 'automatic',
'trim': 'Clio 1.6 E-Tech 140ch Business',
'vin': None,
'year': 2021}
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877993%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [ayvens.fr] INFO: Saving data for 1877993: {'created_time': 1769630896.609107, 'last_price_update_time': 1769630896.609118, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877993') HTTP/1.1" 204 0
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/2.jpg not downloaded yet
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/3.jpg not downloaded yet
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/4.jpg not downloaded yet
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/5.jpg not downloaded yet
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/6.jpg not downloaded yet
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/7.jpg not downloaded yet
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/8.jpg not downloaded yet
2026-01-28 20:08:16 [ayvens.fr] INFO: Found listing with ID: 1877996
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877996%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [ayvens.fr] INFO: Scrape type for 1877996: 1
2026-01-28 20:08:16 [ayvens.fr] INFO: Extracting data for car ID: 1877996
2026-01-28 20:08:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f66fa140-b814-5b76-a8bd-119a2fd09545 with identifier: 1877996
2026-01-28 20:08:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66fa140-b814-5b76-a8bd-119a2fd09545 with scrape type 1
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/1.jpg not downloaded yet
2026-01-28 20:08:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/2.jpg not downloaded yet
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfae6a90>
2026-01-28 20:08:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/1.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4529e50>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/2.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4504810>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/4.jpg saved to cache
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/3.jpg not downloaded yet
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c451aa10>
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/5.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c435abd0>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/3.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4470e50>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/6.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4473090>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/7.jpg saved to cache
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/4.jpg not downloaded yet
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4707b10>
2026-01-28 20:08:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffe-%252Fa2676cc267ee499f983d39703f6eb9e7%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/8.jpg saved to cache
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 025ae2e1-11bc-5203-a817-34ba5efe2969
2026-01-28 20:08:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 025ae2e1-11bc-5203-a817-34ba5efe2969, skipping ID generation
2026-01-28 20:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 025ae2e1-11bc-5203-a817-34ba5efe2969 with scrape type 1
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 025ae2e1-11bc-5203-a817-34ba5efe2969 from tracking dictionaries
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 025ae2e1-11bc-5203-a817-34ba5efe2969 sending to next pipeline
2026-01-28 20:08:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 025ae2e1-11bc-5203-a817-34ba5efe2969, identifier: 1877994
2026-01-28 20:08:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 025ae2e1-11bc-5203-a817-34ba5efe2969 with identifier: 1877994
2026-01-28 20:08:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 025ae2e1-11bc-5203-a817-34ba5efe2969 with identifier: 1877994
2026-01-28 20:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 166951 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166951
2026-01-28 20:08:19 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 025ae2e1-11bc-5203-a817-34ba5efe2969 spider: ayvens.fr
2026-01-28 20:08:19 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 025ae2e1-11bc-5203-a817-34ba5efe2969 due to rule: high_mileage_for_country.json, error: 166951 is greater than the maximum of 150000
Failed validating 'maximum' in schema['allOf'][2]['then']['properties']['odometer_in_km']:
{'maximum': 150000, 'type': 'integer'}
On instance['odometer_in_km']:
166951
{'auction_title': '',
'c_o_2_emission_value': 97,
'color': 'NOIR INTENSE NACR',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '025ae2e1-11bc-5203-a817-34ba5efe2969',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 166951,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 461189,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 561370,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 416875,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 329382,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 399674,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_025ae2e1-11bc-5203-a817-34ba5efe2969/025ae2e1-11bc-5203-a817-34ba5efe2969_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 309816,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fe-/a2676cc267ee499f983d39703f6eb9e7/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-03-27',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN POLO Polo 1.6 TDI 95ch Copper Line DSG7 Euro6d-T',
'transmission': 'automatic',
'trim': 'Polo 1.6 TDI 95ch Copper Line DSG7 Euro6d-T',
'vin': None,
'year': 2019}
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877994%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [ayvens.fr] INFO: Saving data for 1877994: {'created_time': 1769630899.518169, 'last_price_update_time': 1769630899.518184, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877994') HTTP/1.1" 204 0
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/5.jpg not downloaded yet
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/6.jpg not downloaded yet
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/7.jpg not downloaded yet
2026-01-28 20:08:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/8.jpg not downloaded yet
2026-01-28 20:08:19 [ayvens.fr] INFO: Found listing with ID: 1877997
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877997%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [ayvens.fr] INFO: Scrape type for 1877997: 1
2026-01-28 20:08:19 [ayvens.fr] INFO: Extracting data for car ID: 1877997
2026-01-28 20:08:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d1464ba-1506-58f8-9a7c-69fe08fab549 with identifier: 1877997
2026-01-28 20:08:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1464ba-1506-58f8-9a7c-69fe08fab549 with scrape type 1
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/1.jpg not downloaded yet
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bfac26d0>
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/6.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/2.jpg not downloaded yet
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4086cd0>
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/3.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4085a50>
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/7.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4218450>
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/1.jpg saved to cache
2026-01-28 20:08:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4705b90>
2026-01-28 20:08:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/5.jpg saved to cache
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419a050>
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/2.jpg saved to cache
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44b2f50>
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/4.jpg saved to cache
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/3.jpg not downloaded yet
2026-01-28 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/4.jpg not downloaded yet
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4546390>
2026-01-28 20:08:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Ffm-%252F66e72af6dc784b408dc97f6d8bad63a3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/8.jpg saved to cache
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161
2026-01-28 20:08:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bd7d2f7d-66bf-5fa3-967c-3f71bb014161, skipping ID generation
2026-01-28 20:08:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161 with scrape type 1
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item bd7d2f7d-66bf-5fa3-967c-3f71bb014161 from tracking dictionaries
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bd7d2f7d-66bf-5fa3-967c-3f71bb014161 sending to next pipeline
2026-01-28 20:08:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: bd7d2f7d-66bf-5fa3-967c-3f71bb014161, identifier: 1877995
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: bd7d2f7d-66bf-5fa3-967c-3f71bb014161 with identifier: 1877995
2026-01-28 20:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: bd7d2f7d-66bf-5fa3-967c-3f71bb014161 with identifier: 1877995
2026-01-28 20:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
2026-01-28 20:08:22 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: bd7d2f7d-66bf-5fa3-967c-3f71bb014161 spider: ayvens.fr
2026-01-28 20:08:22 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: bd7d2f7d-66bf-5fa3-967c-3f71bb014161 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'boxer' containing 'boxer'
{'auction_title': '',
'c_o_2_emission_value': 148,
'color': None,
'currency': 'EUR',
'doors_number': 4,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': 'bd7d2f7d-66bf-5fa3-967c-3f71bb014161',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': 'BOXER',
'odometer': 146777,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 474433,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 414145,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 467288,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 421971,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 297066,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 352228,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bd7d2f7d-66bf-5fa3-967c-3f71bb014161/bd7d2f7d-66bf-5fa3-967c-3f71bb014161_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 505202,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/fm-/66e72af6dc784b408dc97f6d8bad63a3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-10',
'seats_number': 3,
'seller_name': None,
'title': 'PEUGEOT BOXER Boxer Fg 333 L1H1 2.2 BlueHDi S&S 140ch Asphalt',
'transmission': 'manual',
'trim': 'Boxer Fg 333 L1H1 2.2 BlueHDi S&S 140ch Asphalt',
'vin': None,
'year': 2020}
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877995%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [ayvens.fr] INFO: Saving data for 1877995: {'created_time': 1769630902.451906, 'last_price_update_time': 1769630902.451916, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877995') HTTP/1.1" 204 0
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/5.jpg not downloaded yet
2026-01-28 20:08:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/6.jpg not downloaded yet
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4536fd0>
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/4.jpg saved to cache
2026-01-28 20:08:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff56b50>
2026-01-28 20:08:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/6.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c462ab10>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/5.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff52810>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/2.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4585850>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/1.jpg saved to cache
2026-01-28 20:08:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4143690>
2026-01-28 20:08:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/7.jpg saved to cache
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/7.jpg not downloaded yet
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b77d0>
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/3.jpg saved to cache
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/8.jpg not downloaded yet
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42b4890>
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fccefafa917c145128a62a1438ae7e9ea%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/8.jpg saved to cache
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f66fa140-b814-5b76-a8bd-119a2fd09545
2026-01-28 20:08:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f66fa140-b814-5b76-a8bd-119a2fd09545, skipping ID generation
2026-01-28 20:08:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f66fa140-b814-5b76-a8bd-119a2fd09545 with scrape type 1
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f66fa140-b814-5b76-a8bd-119a2fd09545 from tracking dictionaries
2026-01-28 20:08:24 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f66fa140-b814-5b76-a8bd-119a2fd09545 sending to next pipeline
2026-01-28 20:08:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: f66fa140-b814-5b76-a8bd-119a2fd09545, identifier: 1877996
2026-01-28 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: f66fa140-b814-5b76-a8bd-119a2fd09545 with identifier: 1877996
2026-01-28 20:08:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: f66fa140-b814-5b76-a8bd-119a2fd09545 with identifier: 1877996
2026-01-28 20:08:25 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: f66fa140-b814-5b76-a8bd-119a2fd09545 with identifier: 1877996 to the API
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 31,
'color': 'BLEU CELEBES METALLISE',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'phev/petrol',
'id': 'f66fa140-b814-5b76-a8bd-119a2fd09545',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '3008',
'odometer': 44121,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 310308,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 332362,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 290248,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 387838,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 311999,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 282566,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f66fa140-b814-5b76-a8bd-119a2fd09545/f66fa140-b814-5b76-a8bd-119a2fd09545_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 363956,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/ccefafa917c145128a62a1438ae7e9ea/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-10-20',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 3008 3008 HYBRID 225ch GT e-EAT8',
'transmission': 'automatic',
'trim': '3008 HYBRID 225ch GT e-EAT8',
'vin': None,
'year': 2022}
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877996%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [ayvens.fr] INFO: Saving data for 1877996: {'created_time': 1769630905.329032, 'last_price_update_time': 1769630905.329047, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877996') HTTP/1.1" 204 0
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [ayvens.fr] INFO: Found listing with ID: 1877998
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877998%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [ayvens.fr] INFO: Scrape type for 1877998: 1
2026-01-28 20:08:25 [ayvens.fr] INFO: Extracting data for car ID: 1877998
2026-01-28 20:08:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c836697-3e4f-5092-a827-3c081757b78e with identifier: 1877998
2026-01-28 20:08:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c836697-3e4f-5092-a827-3c081757b78e with scrape type 1
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/1.jpg not downloaded yet
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/2.jpg not downloaded yet
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4255810>
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/2.jpg saved to cache
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43b2a10>
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/1.jpg saved to cache
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/3.jpg not downloaded yet
2026-01-28 20:08:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/4.jpg not downloaded yet
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43490d0>
2026-01-28 20:08:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/3.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c452b710>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/4.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c418eb90>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/5.jpg saved to cache
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/5.jpg not downloaded yet
2026-01-28 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/6.jpg not downloaded yet
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419d210>
2026-01-28 20:08:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/6.jpg saved to cache
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/7.jpg not downloaded yet
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/8.jpg not downloaded yet
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417ca90>
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/7.jpg saved to cache
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45858d0>
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgs-%252F493d8f3626b64fb0b6152d3e33e7a3af%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/8.jpg saved to cache
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d1464ba-1506-58f8-9a7c-69fe08fab549
2026-01-28 20:08:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d1464ba-1506-58f8-9a7c-69fe08fab549, skipping ID generation
2026-01-28 20:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2d1464ba-1506-58f8-9a7c-69fe08fab549 with scrape type 1
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2d1464ba-1506-58f8-9a7c-69fe08fab549 from tracking dictionaries
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d1464ba-1506-58f8-9a7c-69fe08fab549 sending to next pipeline
2026-01-28 20:08:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2d1464ba-1506-58f8-9a7c-69fe08fab549, identifier: 1877997
2026-01-28 20:08:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:27 [ayvens.fr] INFO: Found listing with ID: 1877999
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877999%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [ayvens.fr] INFO: Scrape type for 1877999: 1
2026-01-28 20:08:27 [ayvens.fr] INFO: Extracting data for car ID: 1877999
2026-01-28 20:08:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90c1f200-9c81-5cf2-99d0-38975352c1d4 with identifier: 1877999
2026-01-28 20:08:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c1f200-9c81-5cf2-99d0-38975352c1d4 with scrape type 1
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/1.jpg not downloaded yet
2026-01-28 20:08:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2d1464ba-1506-58f8-9a7c-69fe08fab549 with identifier: 1877997
2026-01-28 20:08:27 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2d1464ba-1506-58f8-9a7c-69fe08fab549 with identifier: 1877997
2026-01-28 20:08:28 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2d1464ba-1506-58f8-9a7c-69fe08fab549 with identifier: 1877997 to the API
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 147,
'color': 'SAPHIRSCHWARZ METALLIS',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '2d1464ba-1506-58f8-9a7c-69fe08fab549',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'X2',
'odometer': 28623,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 420060,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314168,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 316807,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 277647,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328375,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 284780,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d1464ba-1506-58f8-9a7c-69fe08fab549/2d1464ba-1506-58f8-9a7c-69fe08fab549_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 328763,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gs-/493d8f3626b64fb0b6152d3e33e7a3af/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-12-04',
'seats_number': 5,
'seller_name': None,
'title': 'BMW X2 X2 sDrive18iA 136ch M Sport DKG7',
'transmission': 'automatic',
'trim': 'X2 sDrive18iA 136ch M Sport DKG7',
'vin': None,
'year': 2023}
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877997%27 HTTP/1.1" 200 None
2026-01-28 20:08:28 [ayvens.fr] INFO: Saving data for 1877997: {'created_time': 1769630908.303367, 'last_price_update_time': 1769630908.303378, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877997') HTTP/1.1" 204 0
2026-01-28 20:08:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:28 [scrapy.extensions.logstats] INFO: Crawled 11 pages (at 1 pages/min), scraped 52 items (at 7 items/min)
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/2.jpg not downloaded yet
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f86d0>
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/1.jpg saved to cache
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41607d0>
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/2.jpg saved to cache
2026-01-28 20:08:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4162790>
2026-01-28 20:08:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/4.jpg saved to cache
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/3.jpg not downloaded yet
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/4.jpg not downloaded yet
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c441af50>
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/3.jpg saved to cache
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/5.jpg not downloaded yet
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/6.jpg not downloaded yet
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c42c6b10>
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/5.jpg saved to cache
2026-01-28 20:08:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4575050>
2026-01-28 20:08:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/6.jpg saved to cache
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff56790>
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/7.jpg saved to cache
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/7.jpg not downloaded yet
2026-01-28 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/8.jpg not downloaded yet
2026-01-28 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:30 [ayvens.fr] INFO: Found listing with ID: 1878000
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271878000%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [ayvens.fr] INFO: Scrape type for 1878000: 1
2026-01-28 20:08:30 [ayvens.fr] INFO: Extracting data for car ID: 1878000
2026-01-28 20:08:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a62ca44d-fc94-5f30-8069-1407cb06a233 with identifier: 1878000
2026-01-28 20:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62ca44d-fc94-5f30-8069-1407cb06a233 with scrape type 1
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg not downloaded yet
2026-01-28 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg not downloaded yet
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg not downloaded yet
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d39d0>
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2006
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252Fa9e11e3ec0bf4e8ca3099dd862f938a3%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/8.jpg saved to cache
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c836697-3e4f-5092-a827-3c081757b78e
2026-01-28 20:08:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c836697-3e4f-5092-a827-3c081757b78e, skipping ID generation
2026-01-28 20:08:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c836697-3e4f-5092-a827-3c081757b78e with scrape type 1
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 2c836697-3e4f-5092-a827-3c081757b78e from tracking dictionaries
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c836697-3e4f-5092-a827-3c081757b78e sending to next pipeline
2026-01-28 20:08:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 2c836697-3e4f-5092-a827-3c081757b78e, identifier: 1877998
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg not downloaded yet
2026-01-28 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 2c836697-3e4f-5092-a827-3c081757b78e with identifier: 1877998
2026-01-28 20:08:30 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 2c836697-3e4f-5092-a827-3c081757b78e with identifier: 1877998
2026-01-28 20:08:30 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 2c836697-3e4f-5092-a827-3c081757b78e with identifier: 1877998 to the API
2026-01-28 20:08:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/8.jpg>
{'auction_title': '',
'c_o_2_emission_value': 155,
'color': 'MINERAL GRAU',
'currency': 'EUR',
'doors_number': 4,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '2c836697-3e4f-5092-a827-3c081757b78e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'BMW',
'model': 'SERIE 3',
'odometer': 72624,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 380659,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 314796,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 257990,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 337043,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 267118,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 259095,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c836697-3e4f-5092-a827-3c081757b78e/2c836697-3e4f-5092-a827-3c081757b78e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405296,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/a9e11e3ec0bf4e8ca3099dd862f938a3/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-07-21',
'seats_number': 5,
'seller_name': None,
'title': 'BMW SERIE 3 Serie 3 320iA xDrive 184ch Business Design',
'transmission': 'automatic',
'trim': 'Serie 3 320iA xDrive 184ch Business Design',
'vin': None,
'year': 2023}
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877998%27 HTTP/1.1" 200 None
2026-01-28 20:08:31 [ayvens.fr] INFO: Saving data for 1877998: {'created_time': 1769630911.356481, 'last_price_update_time': 1769630911.356494, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877998') HTTP/1.1" 204 0
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg not downloaded yet
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41da3d0>
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/1.jpg saved to cache
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c44d1390>
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/2.jpg saved to cache
2026-01-28 20:08:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:31 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4585510>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/3.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff56350>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/4.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg not downloaded yet
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg not downloaded yet
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg not downloaded yet
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [ayvens.fr] INFO: Found listing with ID: 1878001
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271878001%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [ayvens.fr] INFO: Scrape type for 1878001: 1
2026-01-28 20:08:32 [ayvens.fr] INFO: Extracting data for car ID: 1878001
2026-01-28 20:08:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 81d3d721-0703-53d6-88ff-de4c00dbbcd4 with identifier: 1878001
2026-01-28 20:08:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4 with scrape type 1
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg not downloaded yet
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg not downloaded yet
2026-01-28 20:08:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417e5d0>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/8.jpg saved to cache
2026-01-28 20:08:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4467610>
2026-01-28 20:08:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/6.jpg saved to cache
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4585050>
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/7.jpg saved to cache
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg not downloaded yet
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ae850>
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fer-%252F623f3be6abbb4fecad549b2d36526e48%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/5.jpg saved to cache
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90c1f200-9c81-5cf2-99d0-38975352c1d4
2026-01-28 20:08:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90c1f200-9c81-5cf2-99d0-38975352c1d4, skipping ID generation
2026-01-28 20:08:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90c1f200-9c81-5cf2-99d0-38975352c1d4 with scrape type 1
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 90c1f200-9c81-5cf2-99d0-38975352c1d4 from tracking dictionaries
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90c1f200-9c81-5cf2-99d0-38975352c1d4 sending to next pipeline
2026-01-28 20:08:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 90c1f200-9c81-5cf2-99d0-38975352c1d4, identifier: 1877999
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg not downloaded yet
2026-01-28 20:08:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 90c1f200-9c81-5cf2-99d0-38975352c1d4 with identifier: 1877999
2026-01-28 20:08:33 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='en',RowKey='en') HTTP/1.1" 204 0
2026-01-28 20:08:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 90c1f200-9c81-5cf2-99d0-38975352c1d4 with identifier: 1877999
2026-01-28 20:08:34 [crawlers.pipelines.post_to_api] INFO: Spider: ayvens.fr, Posting item: 90c1f200-9c81-5cf2-99d0-38975352c1d4 with identifier: 1877999 to the API
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-01-28 20:08:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/5.jpg>
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': 'GRIS INDIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'diesel',
'id': '90c1f200-9c81-5cf2-99d0-38975352c1d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 119021,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431757,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 431757,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 374922,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 405512,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 402529,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 344642,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 351703,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90c1f200-9c81-5cf2-99d0-38975352c1d4/90c1f200-9c81-5cf2-99d0-38975352c1d4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 390569,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/er-/623f3be6abbb4fecad549b2d36526e48/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-10-04',
'seats_number': 5,
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN Tiguan 2.0 TDI 150ch Confortline Business DSG7',
'transmission': 'automatic',
'trim': 'Tiguan 2.0 TDI 150ch Confortline Business DSG7',
'vin': None,
'year': 2017}
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271877999%27 HTTP/1.1" 200 None
2026-01-28 20:08:34 [ayvens.fr] INFO: Saving data for 1877999: {'created_time': 1769630914.328588, 'last_price_update_time': 1769630914.328601, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1877999') HTTP/1.1" 204 0
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4588290>
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg saved to cache
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c45ba0d0>
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg saved to cache
2026-01-28 20:08:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c417da90>
2026-01-28 20:08:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg saved to cache
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg not downloaded yet
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg not downloaded yet
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg not downloaded yet
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg not downloaded yet
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:35 [ayvens.fr] INFO: Found listing with ID: 1878002
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271878002%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [ayvens.fr] INFO: Scrape type for 1878002: 1
2026-01-28 20:08:35 [ayvens.fr] INFO: Extracting data for car ID: 1878002
2026-01-28 20:08:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 with identifier: 1878002
2026-01-28 20:08:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 with scrape type 1
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F1.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/1.jpg not downloaded yet
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F2.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/2.jpg not downloaded yet
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41f81d0>
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg saved to cache
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4380f50>
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg saved to cache
2026-01-28 20:08:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4629410>
2026-01-28 20:08:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg saved to cache
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff16610>
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg saved to cache
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F3.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/3.jpg not downloaded yet
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41da110>
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgq-%252F864a76b2801f412ea580d009ff0414a9%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg saved to cache
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a62ca44d-fc94-5f30-8069-1407cb06a233
2026-01-28 20:08:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a62ca44d-fc94-5f30-8069-1407cb06a233, skipping ID generation
2026-01-28 20:08:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a62ca44d-fc94-5f30-8069-1407cb06a233 with scrape type 1
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a62ca44d-fc94-5f30-8069-1407cb06a233 from tracking dictionaries
2026-01-28 20:08:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a62ca44d-fc94-5f30-8069-1407cb06a233 sending to next pipeline
2026-01-28 20:08:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: a62ca44d-fc94-5f30-8069-1407cb06a233, identifier: 1878000
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4706bd0>
2026-01-28 20:08:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg saved to cache
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4574190>
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg saved to cache
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F4.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/4.jpg not downloaded yet
2026-01-28 20:08:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: a62ca44d-fc94-5f30-8069-1407cb06a233 with identifier: 1878000
2026-01-28 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: a62ca44d-fc94-5f30-8069-1407cb06a233 with identifier: 1878000
2026-01-28 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208 business r', 'trim': '208 business r 1.2 puretech 100 s&s active // 5 places / 5 seats vasp', 'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s active // 5 places / 5 seats vasp', 'price': 0, 'odometer': 8957, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-09', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 116, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a62ca44d-fc94-5f30-8069-1407cb06a233', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 535704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 535704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 485754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 353464}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 340047}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 308494}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 214579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 413313}], 'current_year_diff': 3, 'age_in_months': 29, 'make_model': 'peugeot 208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 8957}
Failed validating None in schema:
False
On instance:
{'age_in_months': 29,
'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'gris platinium',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'a62ca44d-fc94-5f30-8069-1407cb06a233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208 business r',
'model': '208 business r',
'odometer': 8957,
'odometer_in_km': 8957,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-09',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s '
'active // 5 places / 5 seats vasp',
'transmission': 'manual',
'trim': '208 business r 1.2 puretech 100 s&s active // 5 places / 5 '
'seats vasp',
'vin': None,
'year': 2023}
2026-01-28 20:08:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: a62ca44d-fc94-5f30-8069-1407cb06a233 spider: ayvens.fr
2026-01-28 20:08:37 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: a62ca44d-fc94-5f30-8069-1407cb06a233 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208 business r', 'trim': '208 business r 1.2 puretech 100 s&s active // 5 places / 5 seats vasp', 'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s active // 5 places / 5 seats vasp', 'price': 0, 'odometer': 8957, 'odometer_reading_unit': 'km', 'registration_date': '2023-08-09', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 116, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': 'a62ca44d-fc94-5f30-8069-1407cb06a233', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 535704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 535704}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 485754}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 353464}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 340047}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 308494}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 214579}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 413313}], 'current_year_diff': 3, 'age_in_months': 29, 'make_model': 'peugeot 208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 8957}
Failed validating None in schema:
False
On instance:
{'age_in_months': 29,
'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'gris platinium',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': 'a62ca44d-fc94-5f30-8069-1407cb06a233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208 business r',
'model': '208 business r',
'odometer': 8957,
'odometer_in_km': 8957,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-09',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s '
'active // 5 places / 5 seats vasp',
'transmission': 'manual',
'trim': '208 business r 1.2 puretech 100 s&s active // 5 places / 5 '
'seats vasp',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': 'a62ca44d-fc94-5f30-8069-1407cb06a233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208 BUSINESS R',
'odometer': 8957,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 535704,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 485754,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353464,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340047,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 308494,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214579,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a62ca44d-fc94-5f30-8069-1407cb06a233/a62ca44d-fc94-5f30-8069-1407cb06a233_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 413313,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gq-/864a76b2801f412ea580d009ff0414a9/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-08-09',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 BUSINESS R 208 Business R 1.2 PureTech 100 S&S Active '
'// 5 places / 5 seats VASP',
'transmission': 'manual',
'trim': '208 Business R 1.2 PureTech 100 S&S Active // 5 places / 5 seats '
'VASP',
'vin': None,
'year': 2023}
2026-01-28 20:08:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271878000%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Saving data for 1878000: {'created_time': 1769630918.000697, 'last_price_update_time': 1769630918.000709, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1878000') HTTP/1.1" 204 0
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F5.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/5.jpg not downloaded yet
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F6.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/6.jpg not downloaded yet
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/1.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F7.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/7.jpg not downloaded yet
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F8.jpg%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/8.jpg not downloaded yet
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873334
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873334%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873334: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873335
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873335%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873335: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873336
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873336%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873336: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873337
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873337%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873337: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873338
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873338%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873338: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873339
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873339%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873339: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873340
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873340%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873340: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873341
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873341%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873341: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873342
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873342%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873342: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873343
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873343%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873343: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873344
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873344%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873344: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873345
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873345%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873345: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873346
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873346%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873346: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873347
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873347%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873347: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873348
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873348%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873348: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873349
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873349%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873349: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873350
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873350%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873350: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873351
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873351%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873351: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873352
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873352%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873352: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873353
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873353%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873353: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873354
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873354%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873354: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873355
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873355%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873355: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873356
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873356%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873356: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873357
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873357%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873357: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873358
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873358%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873358: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873359
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873359%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873359: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873360
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873360%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873360: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873361
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873361%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873361: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873362
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873362%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873362: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873363
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873363%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873363: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873364
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873364%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873364: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873365
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873365%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873365: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873366
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873366%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873366: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873367
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873367%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873367: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873368
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873368%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873368: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873369
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873369%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873369: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873370
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873370%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873370: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873371
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873371%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873371: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873372
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873372%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873372: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873373
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873373%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873373: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873374
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873374%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873374: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873375
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873375%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873375: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873376
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873376%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873376: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873377
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873377%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873377: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873378
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873378%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873378: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873379
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873379%27 HTTP/1.1" 200 None
2026-01-28 20:08:38 [ayvens.fr] INFO: Scrape type for 1873379: 0
2026-01-28 20:08:38 [ayvens.fr] INFO: Found listing with ID: 1873380
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873380%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873380: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873381
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873381%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873381: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873382
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873382%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873382: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873383
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873383%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873383: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873384
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873384%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873384: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873385
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873385%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873385: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873386
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873386%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873386: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873387
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873387%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873387: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873388
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873388%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873388: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873389
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873389%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873389: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873390
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873390%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873390: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873391
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873391%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873391: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873392
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873392%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873392: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873393
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873393%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873393: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873394
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873394%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873394: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873395
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873395%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873395: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873396
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873396%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873396: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873397
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873397%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873397: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873398
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873398%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873398: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Found listing with ID: 1873399
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873399%27 HTTP/1.1" 200 None
2026-01-28 20:08:39 [ayvens.fr] INFO: Scrape type for 1873399: 0
2026-01-28 20:08:39 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 600
2026-01-28 20:08:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c47041d0>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg saved to cache
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c40e71d0>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg saved to cache
2026-01-28 20:08:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff7a9d0>
2026-01-28 20:08:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2002
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bf1d2950>
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ccc90>
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41ef110>
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2001
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgr-%252F8d7ce4f7ad884b8f85331034df6a9b50%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg saved to cache
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4
2026-01-28 20:08:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 81d3d721-0703-53d6-88ff-de4c00dbbcd4, skipping ID generation
2026-01-28 20:08:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4 with scrape type 1
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 81d3d721-0703-53d6-88ff-de4c00dbbcd4 from tracking dictionaries
2026-01-28 20:08:40 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 81d3d721-0703-53d6-88ff-de4c00dbbcd4 sending to next pipeline
2026-01-28 20:08:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 81d3d721-0703-53d6-88ff-de4c00dbbcd4, identifier: 1878001
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c419de90>
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_0.jpg HTTP/1.1" 201 0
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F1.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/1.jpg saved to cache
2026-01-28 20:08:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/4.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 81d3d721-0703-53d6-88ff-de4c00dbbcd4 with identifier: 1878001
2026-01-28 20:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 81d3d721-0703-53d6-88ff-de4c00dbbcd4 with identifier: 1878001
2026-01-28 20:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208 business r', 'trim': '208 business r 1.2 puretech 100 s&s active - vasp - transfo 5 places / 5 seats ok + certif ok', 'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s active - vasp - transfo 5 places / 5 seats ok + certif ok', 'price': 0, 'odometer': 9742, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-04', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 116, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '81d3d721-0703-53d6-88ff-de4c00dbbcd4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 544417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 544417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 488132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317200}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 250279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 232264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 495993}], 'current_year_diff': 3, 'age_in_months': 28, 'make_model': 'peugeot 208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 9742}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'gris platinium',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '81d3d721-0703-53d6-88ff-de4c00dbbcd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208 business r',
'model': '208 business r',
'odometer': 9742,
'odometer_in_km': 9742,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-04',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s '
'active - vasp - transfo 5 places / 5 seats ok + certif ok',
'transmission': 'manual',
'trim': '208 business r 1.2 puretech 100 s&s active - vasp - transfo '
'5 places / 5 seats ok + certif ok',
'vin': None,
'year': 2023}
2026-01-28 20:08:41 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: PURETECH_FOR_COUNTRY failed for item: 81d3d721-0703-53d6-88ff-de4c00dbbcd4 spider: ayvens.fr
2026-01-28 20:08:41 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 81d3d721-0703-53d6-88ff-de4c00dbbcd4 due to rule: puretech_for_country.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'gris platinium', 'original_photo_count': 8, 'seller_name': None, 'price_includes_vat': False, 'make': 'peugeot', 'model': '208 business r', 'trim': '208 business r 1.2 puretech 100 s&s active - vasp - transfo 5 places / 5 seats ok + certif ok', 'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s active - vasp - transfo 5 places / 5 seats ok + certif ok', 'price': 0, 'odometer': 9742, 'odometer_reading_unit': 'km', 'registration_date': '2023-09-04', 'year': 2023, 'fuel_type': 'petrol', 'listing': 'auction', 'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154', 'expiration_date': '2026-01-29t14:00:00z', 'is_vat_included': True, 'is_vat_deductible': False, 'doors_number': 5, 'seats_number': 5, 'vin': None, 'license_plate': None, 'engine': '0.1l', 'c_o_2_emission_value': 116, 'origin_country_code': 'fr', 'transmission': 'manual', 'location': None, 'currency': 'eur', 'id': '81d3d721-0703-53d6-88ff-de4c00dbbcd4', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_0.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 544417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_1.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 544417}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_2.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 488132}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_3.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 317200}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_4.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 346745}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_5.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 250279}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_6.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 232264}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_7.jpg', 'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg', 'Width': 1024, 'Height': 768, 'Extension': 'jpg', 'FileSizeInBytes': 495993}], 'current_year_diff': 3, 'age_in_months': 28, 'make_model': 'peugeot 208 business r', 'sanitized_make': 'peugeot', 'odometer_in_km': 9742}
Failed validating None in schema:
False
On instance:
{'age_in_months': 28,
'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'gris platinium',
'currency': 'eur',
'current_year_diff': 3,
'doors_number': 5,
'engine': '0.1l',
'expiration_date': '2026-01-29t14:00:00z',
'fuel_type': 'petrol',
'id': '81d3d721-0703-53d6-88ff-de4c00dbbcd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'peugeot',
'make_model': 'peugeot 208 business r',
'model': '208 business r',
'odometer': 9742,
'odometer_in_km': 9742,
'odometer_reading_unit': 'km',
'origin_country_code': 'fr',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-04',
'sanitized_make': 'peugeot',
'seats_number': 5,
'seller_name': None,
'title': 'peugeot 208 business r 208 business r 1.2 puretech 100 s&s '
'active - vasp - transfo 5 places / 5 seats ok + certif ok',
'transmission': 'manual',
'trim': '208 business r 1.2 puretech 100 s&s active - vasp - transfo '
'5 places / 5 seats ok + certif ok',
'vin': None,
'year': 2023}
{'auction_title': '',
'c_o_2_emission_value': 116,
'color': 'GRIS PLATINIUM',
'currency': 'EUR',
'doors_number': 5,
'engine': '0.1L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'petrol',
'id': '81d3d721-0703-53d6-88ff-de4c00dbbcd4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'PEUGEOT',
'model': '208 BUSINESS R',
'odometer': 9742,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 544417,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 488132,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 317200,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 346745,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 250279,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 232264,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_81d3d721-0703-53d6-88ff-de4c00dbbcd4/81d3d721-0703-53d6-88ff-de4c00dbbcd4_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 495993,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gr-/8d7ce4f7ad884b8f85331034df6a9b50/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-09-04',
'seats_number': 5,
'seller_name': None,
'title': 'PEUGEOT 208 BUSINESS R 208 Business R 1.2 PureTech 100 S&S Active - '
'VASP - TRANSFO 5 PLACES / 5 SEATS OK + CERTIF OK',
'transmission': 'manual',
'trim': '208 Business R 1.2 PureTech 100 S&S Active - VASP - TRANSFO 5 PLACES '
'/ 5 SEATS OK + CERTIF OK',
'vin': None,
'year': 2023}
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271878001%27 HTTP/1.1" 200 None
2026-01-28 20:08:41 [ayvens.fr] INFO: Saving data for 1878001: {'created_time': 1769630921.811257, 'last_price_update_time': 1769630921.811268, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1878001') HTTP/1.1" 204 0
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/2.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/3.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/5.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/6.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/8.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4048950>
2026-01-28 20:08:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2007
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_3.jpg HTTP/1.1" 201 0
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F4.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/4.jpg saved to cache
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/7.jpg> (referer: https://api.aldcarmarket.com/graphql/saleevents)
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c43a6d10>
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_1.jpg HTTP/1.1" 201 0
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F2.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/2.jpg saved to cache
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4392f10>
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_2.jpg HTTP/1.1" 201 0
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F3.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/3.jpg saved to cache
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4282dd0>
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_4.jpg HTTP/1.1" 201 0
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F5.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/5.jpg saved to cache
2026-01-28 20:08:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c4518d50>
2026-01-28 20:08:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_5.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F6.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/6.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52c41a64d0>
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2010
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_7.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F8.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/8.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f52bff545d0>
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2009
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-01-28 20:08:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_6.jpg HTTP/1.1" 201 0
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='ayvens.fr',RowKey='https%3A%252F%252Fmedias-carmarket.ayvens.com%252Flots%252Fald%252Fgk-%252Fe3780175afbd4c648be691ed45961af8%252Fimages%252Flarge%252F7.jpg') HTTP/1.1" 204 0
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/7.jpg saved to cache
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85
2026-01-28 20:08:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85, skipping ID generation
2026-01-28 20:08:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 with scrape type 1
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 from tracking dictionaries
2026-01-28 20:08:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 sending to next pipeline
2026-01-28 20:08:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: ayvens.fr, Processed item id: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85, identifier: 1878002
2026-01-28 20:08:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: ayvens.fr, Translating item: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 with identifier: 1878002
2026-01-28 20:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: ayvens.fr, Applying rules to item: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 with identifier: 1878002
2026-01-28 20:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
2026-01-28 20:08:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MISSING_COLOR failed for item: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 spider: ayvens.fr
2026-01-28 20:08:44 [scrapy.core.scraper] INFO: Dropped: Spider: ayvens.fr, Dropping listing: 13ce9fcc-503c-5b8d-b68f-dfaec907bf85 due to rule: missing_color.json, error: None is not of type 'string'
Failed validating 'type' in schema['properties']['color']:
{'minLength': 1, 'type': 'string'}
On instance['color']:
None
{'auction_title': '',
'c_o_2_emission_value': 127,
'color': None,
'currency': 'EUR',
'doors_number': 5,
'engine': '0.2L',
'expiration_date': '2026-01-29T14:00:00Z',
'fuel_type': 'hybrid/petrol',
'id': '13ce9fcc-503c-5b8d-b68f-dfaec907bf85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': True,
'license_plate': None,
'link_to_web_offer': 'https://carmarket.ayvens.com/en-gb/sales/39154',
'listing': 'auction',
'location': None,
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 93493,
'odometer_reading_unit': 'km',
'origin_country_code': 'FR',
'original_photo_count': 8,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/1.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 383482,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/2.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 353542,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/3.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 293130,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/4.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 300810,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/5.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 340064,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/6.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 348885,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/7.jpg',
'Width': 1024},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_13ce9fcc-503c-5b8d-b68f-dfaec907bf85/13ce9fcc-503c-5b8d-b68f-dfaec907bf85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178658,
'Height': 768,
'OriginUrl': 'https://medias-carmarket.ayvens.com/lots/ald/gk-/e3780175afbd4c648be691ed45961af8/images/large/8.jpg',
'Width': 1024}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-11-16',
'seats_number': 5,
'seller_name': None,
'title': 'HYUNDAI TUCSON Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'transmission': 'automatic',
'trim': 'Tucson 1.6 T-GDi 230ch Hybrid Business BVA6',
'vin': None,
'year': 2022}
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271878002%27 HTTP/1.1" 200 None
2026-01-28 20:08:44 [ayvens.fr] INFO: Saving data for 1878002: {'created_time': 1769630924.097743, 'last_price_update_time': 1769630924.097753, 'auction_closing_time': 1769695200.0}
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='ayvens.fr',RowKey='1878002') HTTP/1.1" 204 0
2026-01-28 20:08:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873400
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873400%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873400: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873401
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873401%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873401: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873402
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873402%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873402: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873403
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873403%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873403: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873404
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873404%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873404: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873405
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873405%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873405: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873406
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873406%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873406: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873407
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873407%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873407: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873408
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873408%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873408: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873409
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873409%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873409: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873410
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873410%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873410: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873411
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873411%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873411: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873412
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873412%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873412: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873413
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873413%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873413: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873414
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873414%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873414: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873415
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873415%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873415: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873416
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873416%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873416: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873417
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873417%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873417: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873418
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873418%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873418: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873419
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873419%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873419: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873420
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873420%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873420: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873421
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873421%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873421: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873422
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873422%27 HTTP/1.1" 200 None
2026-01-28 20:08:45 [ayvens.fr] INFO: Scrape type for 1873422: 0
2026-01-28 20:08:45 [ayvens.fr] INFO: Found listing with ID: 1873423
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873423%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873423: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873424
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873424%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873424: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873425
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873425%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873425: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873426
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873426%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873426: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873427
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873427%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873427: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873428
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873428%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873428: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873429
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873429%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873429: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873430
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873430%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873430: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873431
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873431%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873431: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873432
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873432%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873432: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873433
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873433%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873433: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873434
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873434%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873434: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873435
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873435%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873435: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873436
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873436%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873436: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873437
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873437%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873437: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873438
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873438%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873438: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873439
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873439%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873439: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873440
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873440%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873440: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873441
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873441%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873441: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873442
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873442%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873442: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873443
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873443%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873443: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873444
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873444%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873444: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873445
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873445%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873445: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873446
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873446%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873446: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873447
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873447%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873447: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873448
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873448%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873448: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873449
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873449%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873449: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873450
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873450%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873450: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873451
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873451%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873451: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873452
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873452%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873452: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873453
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873453%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873453: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873454
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873454%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873454: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873455
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873455%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873455: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873456
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873456%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873456: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873457
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873457%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873457: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873458
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873458%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873458: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873459
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873459%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873459: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873460
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873460%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873460: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873461
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873461%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873461: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873462
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873462%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873462: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873463
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873463%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873463: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873464
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873464%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873464: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873465
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873465%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873465: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873466
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873466%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873466: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873467
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873467%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873467: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873468
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873468%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873468: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873469
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873469%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873469: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873470
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873470%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873470: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873471
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873471%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873471: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873472
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873472%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873472: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873473
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873473%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873473: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873474
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873474%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873474: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873475
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873475%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873475: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873476
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873476%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873476: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873477
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873477%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873477: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873478
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873478%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873478: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873479
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873479%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873479: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873480
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873480%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873480: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873481
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873481%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873481: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873482
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873482%27 HTTP/1.1" 200 None
2026-01-28 20:08:46 [ayvens.fr] INFO: Scrape type for 1873482: 0
2026-01-28 20:08:46 [ayvens.fr] INFO: Found listing with ID: 1873483
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873483%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873483: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873484
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873484%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873484: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873485
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873485%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873485: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873486
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873486%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873486: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873487
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873487%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873487: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873488
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873488%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873488: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873489
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873489%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873489: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873490
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873490%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873490: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873491
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873491%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873491: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873492
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873492%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873492: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873493
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873493%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873493: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873494
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873494%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873494: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873495
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873495%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873495: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873496
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873496%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873496: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873497
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873497%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873497: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873498
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873498%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873498: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Found listing with ID: 1873499
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873499%27 HTTP/1.1" 200 None
2026-01-28 20:08:47 [ayvens.fr] INFO: Scrape type for 1873499: 0
2026-01-28 20:08:47 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 700
2026-01-28 20:08:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:08:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873500
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873500%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873500: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873501
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873501%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873501: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873502
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873502%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873502: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873503
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873503%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873503: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873504
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873504%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873504: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873505
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873505%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873505: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873506
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873506%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873506: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873507
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873507%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873507: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873508
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873508%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873508: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873509
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873509%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873509: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873510
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873510%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873510: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873511
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873511%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873511: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873512
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873512%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873512: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873513
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873513%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873513: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873514
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873514%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873514: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873515
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873515%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873515: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873516
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873516%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873516: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873517
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873517%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873517: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873518
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873518%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873518: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873519
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873519%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873519: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873520
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873520%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873520: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873521
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873521%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873521: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873522
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873522%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873522: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873523
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873523%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873523: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873524
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873524%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873524: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873525
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873525%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873525: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873526
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873526%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873526: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873527
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873527%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873527: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873528
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873528%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873528: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873529
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873529%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873529: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873530
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873530%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873530: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873531
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873531%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873531: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873532
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873532%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873532: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873533
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873533%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873533: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873534
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873534%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873534: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873535
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873535%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873535: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873536
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873536%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873536: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873537
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873537%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873537: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873538
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873538%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873538: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873539
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873539%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873539: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873540
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873540%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873540: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873541
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873541%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873541: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873542
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873542%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873542: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873543
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873543%27 HTTP/1.1" 200 None
2026-01-28 20:08:49 [ayvens.fr] INFO: Scrape type for 1873543: 0
2026-01-28 20:08:49 [ayvens.fr] INFO: Found listing with ID: 1873544
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873544%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873544: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873545
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873545%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873545: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873546
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873546%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873546: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873547
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873547%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873547: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873548
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873548%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873548: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873549
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873549%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873549: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873550
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873550%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873550: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873551
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873551%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873551: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873552
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873552%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873552: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873553
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873553%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873553: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873554
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873554%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873554: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873555
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873555%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873555: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873556
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873556%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873556: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Found listing with ID: 1873557
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20RowKey%20eq%20%271873557%27 HTTP/1.1" 200 None
2026-01-28 20:08:50 [ayvens.fr] INFO: Scrape type for 1873557: 0
2026-01-28 20:08:50 [ayvens.fr] INFO: Fetching listings with token: 3b2cc62fd26c4e29a762db3de181266b and skip: 800
2026-01-28 20:08:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-01-28 20:08:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://api.aldcarmarket.com/graphql/saleevents> (referer: https://carmarket.ayvens.com/) ['zyte-api']
2026-01-28 20:08:53 [scrapy.core.engine] INFO: Closing spider (finished)
2026-01-28 20:08:53 [ayvens.fr] INFO: ayvens.fr Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 158}
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-01-28 20:08:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27ayvens.fr%27%20and%20last_price_update_time%20lt%201769198933 HTTP/1.1" 200 None
2026-01-28 20:08:53 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (54 items) in: file:///var/lib/scrapyd/items/sourcing_v2/ayvens.fr/task_73_2026-01-28T20_00_01.jl
2026-01-28 20:08:53 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 509503,
'downloader/request_count': 1081,
'downloader/request_method_count/GET': 1072,
'downloader/request_method_count/POST': 9,
'downloader/response_bytes': 386976478,
'downloader/response_count': 1081,
'downloader/response_status_count/200': 1081,
'elapsed_time_seconds': 505.523151,
'feedexport/success_count/FileFeedStorage': 1,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 1, 28, 20, 8, 53, 784529, tzinfo=datetime.timezone.utc),
'item_dropped_count': 84,
'item_dropped_reasons_count/DropItem': 84,
'item_scraped_count': 54,
'log_count/DEBUG': 13448,
'log_count/INFO': 13086,
'memusage/max': 172199936,
'memusage/startup': 127369216,
'photo_download_count': 1071,
'playwright/context_count': 1,
'playwright/context_count/max_concurrent': 1,
'playwright/context_count/persistent/False': 1,
'playwright/context_count/remote/False': 1,
'playwright/page_count': 1,
'playwright/page_count/max_concurrent': 1,
'playwright/request_count': 154,
'playwright/request_count/aborted': 15,
'playwright/request_count/method/GET': 145,
'playwright/request_count/method/POST': 9,
'playwright/request_count/navigation': 5,
'playwright/request_count/resource_type/document': 5,
'playwright/request_count/resource_type/fetch': 10,
'playwright/request_count/resource_type/font': 16,
'playwright/request_count/resource_type/image': 28,
'playwright/request_count/resource_type/other': 1,
'playwright/request_count/resource_type/script': 88,
'playwright/request_count/resource_type/stylesheet': 1,
'playwright/request_count/resource_type/xhr': 5,
'playwright/response_count': 125,
'playwright/response_count/method/GET': 122,
'playwright/response_count/method/POST': 3,
'playwright/response_count/resource_type/document': 2,
'playwright/response_count/resource_type/fetch': 6,
'playwright/response_count/resource_type/font': 16,
'playwright/response_count/resource_type/image': 12,
'playwright/response_count/resource_type/script': 84,
'playwright/response_count/resource_type/stylesheet': 1,
'playwright/response_count/resource_type/xhr': 4,
'request_depth_max': 9,
'response_received_count': 10,
'scheduler/dequeued': 1081,
'scheduler/dequeued/memory': 1081,
'scheduler/enqueued': 1081,
'scheduler/enqueued/memory': 1081,
'scrapy-zyte-api/429': 0,
'scrapy-zyte-api/attempts': 9,
'scrapy-zyte-api/error_ratio': 0.0,
'scrapy-zyte-api/errors': 0,
'scrapy-zyte-api/fatal_errors': 0,
'scrapy-zyte-api/mean_connection_seconds': 2.9456218066107898,
'scrapy-zyte-api/mean_response_seconds': 3.058972951749132,
'scrapy-zyte-api/processed': 9,
'scrapy-zyte-api/request_args/customHttpRequestHeaders': 9,
'scrapy-zyte-api/request_args/experimental.responseCookies': 9,
'scrapy-zyte-api/request_args/httpRequestBody': 9,
'scrapy-zyte-api/request_args/httpRequestMethod': 9,
'scrapy-zyte-api/request_args/httpResponseBody': 9,
'scrapy-zyte-api/request_args/httpResponseHeaders': 9,
'scrapy-zyte-api/request_args/url': 9,
'scrapy-zyte-api/status_codes/200': 9,
'scrapy-zyte-api/success': 9,
'scrapy-zyte-api/success_ratio': 1.0,
'scrapy-zyte-api/throttle_ratio': 0.0,
'start_time': datetime.datetime(2026, 1, 28, 20, 0, 28, 261378, tzinfo=datetime.timezone.utc)}
2026-01-28 20:08:53 [scrapy.core.engine] INFO: Spider closed (finished)